Max level shown:
1 [ Feb 28 06:43:45 Enabled. ]
2 [ Feb 28 06:43:45 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 28 06:43:45 Method "start" exited with status 0. ]
4 [ Feb 28 06:43:45 Rereading configuration. ]
5 [ Feb 28 06:43:45 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-28T06:43:45.517ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-28T06:43:45.517ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-02-28T06:43:45.570ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-02-28T06:43:45.570ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-28T06:43:45.685ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-28T06:43:45.694ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-28T06:43:45.702ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-02-28T06:43:46.306ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-02-28T06:43:46.447ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-28T06:43:46.447ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-28T06:43:46.447ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-28T06:43:46.447ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-28T06:43:46.447ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-02-28T06:43:46.447ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-02-28T06:43:46.450ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-28T06:43:46.450ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-28T06:43:46.450ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-28T06:43:46.450ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-28T06:43:46.450ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-28T06:43:46.450ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-28T06:43:46.450ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-28T06:43:46.450ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-28T06:43:46.450ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-28T06:43:46.463ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-28T06:43:46.463ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool)
322025-02-28T06:43:46.586ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal }
332025-02-28T06:43:47.037ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-28T06:43:47.037ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-28T06:43:47.037ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-28T06:43:47.037ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-28T06:43:47.037ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-28T06:43:47.037ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-28T06:43:47.037ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-28T06:43:47.046ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-28T06:43:47.046ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool)
422025-02-28T06:43:47.151ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal }
432025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
562025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
572025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-02-28T06:43:47.607ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-02-28T06:43:47.607ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-02-28T06:43:47.607ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-28T06:43:47.607ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-28T06:43:47.607ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-02-28T06:43:47.607ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-02-28T06:43:47.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-02-28T06:43:47.607ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-02-28T06:43:47.608ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-02-28T06:43:47.608ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-28T06:43:47.608ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-28T06:43:47.619ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-28T06:43:47.619ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1374, tv_nsec: 542080843 } time_to_next_cleanup = 599.999914089s
1142025-02-28T06:43:47.619ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1152025-02-28T06:43:47.619ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1162025-02-28T06:43:47.619ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-28T06:43:47.619ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-28T06:43:47.622ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-02-28T06:43:47.623ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-02-28T06:43:47.624ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-28T06:43:47.624ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-28T06:43:47.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-28T06:43:47.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-28T06:43:47.624ZINFOSledAgent (RSS): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-28T06:43:47.624ZINFOSledAgent (RSS): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-28T06:43:47.624ZINFOSledAgent (RSS): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-28T06:43:47.624ZINFOSledAgent (RSS): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-28T06:43:47.624ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-28T06:43:47.624ZINFOSledAgent (RSS): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-28T06:43:47.625ZINFOSledAgent (RSS): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-28T06:43:47.625ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-28T06:43:47.625ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-28T06:43:47.625ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-28T06:43:47.625ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-28T06:43:47.625ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-02-28T06:43:47.625ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-02-28T06:43:47.625ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-02-28T06:43:47.625ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-02-28T06:43:47.625ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 (sled), rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-02-28T06:43:47.625ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-02-28T06:43:47.626ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-02-28T06:43:47.630ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-02-28T06:43:47.636ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-02-28T06:43:47.636ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-02-28T06:43:47.640ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-02-28T06:43:47.643ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-02-28T06:43:47.643ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:49665
1482025-02-28T06:43:47.643ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 (sled), rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-02-28T06:43:47.643ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-02-28T06:43:47.643ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-02-28T06:43:47.643ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-02-28T06:43:47.643ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1542025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1552025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-02-28T06:43:47.643ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-02-28T06:43:47.643ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-02-28T06:43:47.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-28T06:43:47.674ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-28T06:43:47.692ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-28T06:43:47.702ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1662025-02-28T06:43:47.702ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-28T06:43:47.702ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1682025-02-28T06:43:47.702ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1692025-02-28T06:43:47.705ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "05758eec-58f8-4e5c-9cc5-3b8802aeaf82", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "05758eec-58f8-4e5c-9cc5-3b8802aeaf82" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 103.273882ms
1702025-02-28T06:43:47.715ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c3be6427-4bf0-4318-b160-a3ae7a69e6ac/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-28T06:43:47.743ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c3be6427-4bf0-4318-b160-a3ae7a69e6ac/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-28T06:43:47.743ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c3be6427-4bf0-4318-b160-a3ae7a69e6ac/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-28T06:43:47.749ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1742025-02-28T06:43:47.749ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-28T06:43:47.749ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c3be6427-4bf0-4318-b160-a3ae7a69e6ac/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-28T06:43:47.809ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1772025-02-28T06:43:47.810ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d66140b4-5220-4705-aaa1-e0e38bda2256", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d66140b4-5220-4705-aaa1-e0e38bda2256" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 93.747778ms
1782025-02-28T06:43:47.824ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-02-28T06:43:47.905ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1802025-02-28T06:43:47.905ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d597a484-84df-4bed-ab07-8743de59d762", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d597a484-84df-4bed-ab07-8743de59d762" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 168.233185ms
1812025-02-28T06:43:48.043ZINFOSledAgent (BackingFs): Mounting oxi_c3be6427-4bf0-4318-b160-a3ae7a69e6ac/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-02-28T06:43:48.056ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-02-28T06:43:48.056ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-02-28T06:43:48.056ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-02-28T06:43:48.056ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-02-28T06:43:48.075ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1872025-02-28T06:43:48.075ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "250952cc-d594-4662-b4d4-c7dae7c504d5", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "250952cc-d594-4662-b4d4-c7dae7c504d5" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 241.74207ms
1882025-02-28T06:43:48.318ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1892025-02-28T06:43:48.319ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b60a03f3-fd94-4bee-8a8d-7c13d6278cd6", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b60a03f3-fd94-4bee-8a8d-7c13d6278cd6" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 285.697322ms
1902025-02-28T06:43:48.606ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1912025-02-28T06:43:48.606ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5af5c31d-804b-49c1-8cac-9ba71cb1102d", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5af5c31d-804b-49c1-8cac-9ba71cb1102d" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 125.249622ms
1922025-02-28T06:43:48.732ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
1932025-02-28T06:43:48.733ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ee6b5d10-ad72-4835-b410-a6fee4d8af75", "content-length": "124", "date": "Fri, 28 Feb 2025 06:43:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ee6b5d10-ad72-4835-b410-a6fee4d8af75" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 285.979189ms
1942025-02-28T06:43:48.805ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1952025-02-28T06:43:48.811ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:42813 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1962025-02-28T06:43:48.811ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1972025-02-28T06:43:48.811ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:42813 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1982025-02-28T06:43:48.812ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 342.947185ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
1992025-02-28T06:43:48.813ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2002025-02-28T06:43:48.813ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2012025-02-28T06:43:48.813ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2022025-02-28T06:43:48.813ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-02-28T06:43:49.020ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: b221dee6-dc65-449e-974a-6a44e6d144a0, sled_id: ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 }
2042025-02-28T06:43:49.156ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 448.79489ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2052025-02-28T06:43:49.606ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.032367525s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2062025-02-28T06:43:50.640ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.21518501s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2072025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2082025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2092025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2102025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2112025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2122025-02-28T06:43:51.885ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2132025-02-28T06:43:51.887ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2142025-02-28T06:43:51.888ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2152025-02-28T06:43:51.888ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='6404b146-ba86-4141-bc22-d79320112371'/> <propval type="astring" name="rack_id" value='b221dee6-dc65-449e-974a-6a44e6d144a0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe82:fd38'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b221dee6-dc65-449e-974a-6a44e6d144a0'/> <propval type="astring" name="sled_id" value='ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='b221dee6-dc65-449e-974a-6a44e6d144a0'/> <propval type="astring" name="sled_id" value='ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9'/> <propval type="astring" name="rack_uuid" value='b221dee6-dc65-449e-974a-6a44e6d144a0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9'/> <propval type="astring" name="rack_uuid" value='b221dee6-dc65-449e-974a-6a44e6d144a0'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-02-28T06:43:51.888ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2172025-02-28T06:43:52.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 59.830013ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-02-28T06:43:52.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 67.595012ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-02-28T06:43:52.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 292.502838ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-02-28T06:43:52.863ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 570.546509ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-28T06:43:52.863ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.822673291s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2222025-02-28T06:43:53.553ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 550.576276ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-02-28T06:43:54.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 958.216272ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-28T06:43:55.379ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.337127708s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-02-28T06:43:56.689ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.311038024s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2262025-02-28T06:43:56.802ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 927.422118ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2272025-02-28T06:43:58.143ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-02-28T06:43:58.144ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2292025-02-28T06:43:58.145ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-02-28T06:43:58.145ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2312025-02-28T06:43:58.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-02-28T06:43:58.145ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-02-28T06:43:58.146ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-02-28T06:43:58.146ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-02-28T06:43:58.146ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-02-28T06:43:58.146ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2372025-02-28T06:43:58.146ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:49665
2382025-02-28T06:43:58.332ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-02-28T06:43:58.333ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-02-28T06:43:58.337ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412025-02-28T06:43:58.337ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2422025-02-28T06:43:58.337ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2432025-02-28T06:43:58.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65011
2442025-02-28T06:43:58.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-02-28T06:43:58.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-02-28T06:43:58.607ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-02-28T06:43:58.607ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-02-28T06:43:58.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65011 req_id = 2701a097-ab38-4de4-b19d-dfe0324ce950 response_code = 200 uri = /inventory
2492025-02-28T06:43:58.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59682
2502025-02-28T06:43:58.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59682 req_id = 49838909-ea5a-4b32-b94e-6f011efea34c response_code = 200 uri = /sled-role
2512025-02-28T06:43:58.667ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 471c8f6d-3dbc-4f27-9f07-35b220e5098c (physical_disk), pool_id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8054db06-fcb1-43cd-ade1-2a9e1e49005e (physical_disk), pool_id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 89eee9aa-aa18-4957-8ae6-3ff2e29f156a (physical_disk), pool_id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9e3c7005-37a9-4462-a9e4-fb72ae09f6ca (physical_disk), pool_id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a82858ce-5e77-4ffe-bde9-3456bd16e400 (physical_disk), pool_id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c1243127-c9a6-48ec-9c37-7ed8734e2c74 (physical_disk), pool_id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f40275dd-cafc-4883-802d-d7abd22dffaa (physical_disk), pool_id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f5412d99-dad0-4b69-acb0-339681446d27 (physical_disk), pool_id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ff6537e3-0388-4b61-bca8-f4219495488f (physical_disk), pool_id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522025-02-28T06:43:58.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43976
2532025-02-28T06:43:58.667ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2542025-02-28T06:43:58.668ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 471c8f6d-3dbc-4f27-9f07-35b220e5098c (physical_disk), pool_id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 8054db06-fcb1-43cd-ade1-2a9e1e49005e (physical_disk), pool_id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 89eee9aa-aa18-4957-8ae6-3ff2e29f156a (physical_disk), pool_id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9e3c7005-37a9-4462-a9e4-fb72ae09f6ca (physical_disk), pool_id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a82858ce-5e77-4ffe-bde9-3456bd16e400 (physical_disk), pool_id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: c1243127-c9a6-48ec-9c37-7ed8734e2c74 (physical_disk), pool_id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f40275dd-cafc-4883-802d-d7abd22dffaa (physical_disk), pool_id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: f5412d99-dad0-4b69-acb0-339681446d27 (physical_disk), pool_id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ff6537e3-0388-4b61-bca8-f4219495488f (physical_disk), pool_id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552025-02-28T06:43:58.668ZINFOSledAgent (StorageManager): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-02-28T06:43:58.668ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-02-28T06:43:58.668ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582025-02-28T06:43:58.668ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592025-02-28T06:43:58.668ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602025-02-28T06:43:58.668ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612025-02-28T06:43:58.668ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622025-02-28T06:43:58.815ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17265187205636014471 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2632025-02-28T06:43:58.815ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15778910903206655046 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2642025-02-28T06:43:58.817ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652025-02-28T06:43:58.817ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool)
2662025-02-28T06:43:59.028ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2672025-02-28T06:43:59.142ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }
2682025-02-28T06:43:59.148ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
2692025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752025-02-28T06:43:59.150ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762025-02-28T06:43:59.188ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772025-02-28T06:43:59.195ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone file = sled-storage/src/dataset.rs:302
2782025-02-28T06:43:59.366ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a file = sled-storage/src/dataset.rs:388
2792025-02-28T06:43:59.374ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802025-02-28T06:43:59.374ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812025-02-28T06:43:59.375ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822025-02-28T06:43:59.375ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832025-02-28T06:43:59.375ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842025-02-28T06:43:59.385ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852025-02-28T06:43:59.385ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool)
2862025-02-28T06:43:59.496ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }
2872025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-02-28T06:43:59.504ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942025-02-28T06:43:59.545ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-02-28T06:43:59.553ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-02-28T06:43:59.725ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff file = sled-storage/src/dataset.rs:388
2972025-02-28T06:43:59.733ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-02-28T06:43:59.733ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-02-28T06:43:59.733ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-02-28T06:43:59.733ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-02-28T06:43:59.733ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-02-28T06:43:59.743ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-02-28T06:43:59.743ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool)
3042025-02-28T06:43:59.853ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }
3052025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-02-28T06:43:59.861ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-02-28T06:43:59.907ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-02-28T06:43:59.915ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-02-28T06:44:00.086ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031 file = sled-storage/src/dataset.rs:388
3152025-02-28T06:44:00.094ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-02-28T06:44:00.094ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-02-28T06:44:00.094ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-02-28T06:44:00.094ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-02-28T06:44:00.094ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-02-28T06:44:00.104ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-02-28T06:44:00.104ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3430e022-7133-4293-ac77-634fd73d7c3b (zpool)
3222025-02-28T06:44:00.218ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }
3232025-02-28T06:44:00.225ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-02-28T06:44:00.225ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-02-28T06:44:00.225ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-02-28T06:44:00.225ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-02-28T06:44:00.225ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-02-28T06:44:00.226ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-02-28T06:44:00.226ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-02-28T06:44:00.229ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
3312025-02-28T06:44:00.266ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322025-02-28T06:44:00.274ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone file = sled-storage/src/dataset.rs:302
3332025-02-28T06:44:00.440ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3430e022-7133-4293-ac77-634fd73d7c3b file = sled-storage/src/dataset.rs:388
3342025-02-28T06:44:00.447ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352025-02-28T06:44:00.448ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362025-02-28T06:44:00.448ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372025-02-28T06:44:00.448ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382025-02-28T06:44:00.448ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392025-02-28T06:44:00.457ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402025-02-28T06:44:00.457ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 36abc0e0-9d49-4738-89cf-f6343849532d (zpool)
3412025-02-28T06:44:00.562ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }
3422025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-02-28T06:44:00.569ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492025-02-28T06:44:00.606ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502025-02-28T06:44:00.613ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone file = sled-storage/src/dataset.rs:302
3512025-02-28T06:44:00.772ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_36abc0e0-9d49-4738-89cf-f6343849532d file = sled-storage/src/dataset.rs:388
3522025-02-28T06:44:00.779ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532025-02-28T06:44:00.779ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542025-02-28T06:44:00.779ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552025-02-28T06:44:00.779ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562025-02-28T06:44:00.779ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572025-02-28T06:44:00.789ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582025-02-28T06:44:00.789ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool)
3592025-02-28T06:44:00.901ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }
3602025-02-28T06:44:00.908ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612025-02-28T06:44:00.908ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622025-02-28T06:44:00.908ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632025-02-28T06:44:00.908ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642025-02-28T06:44:00.908ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-02-28T06:44:00.909ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-02-28T06:44:00.909ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672025-02-28T06:44:00.947ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-02-28T06:44:00.955ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-02-28T06:44:01.124ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c file = sled-storage/src/dataset.rs:388
3702025-02-28T06:44:01.132ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-02-28T06:44:01.132ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-02-28T06:44:01.132ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-02-28T06:44:01.132ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-02-28T06:44:01.132ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-02-28T06:44:01.142ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-02-28T06:44:01.142ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool)
3772025-02-28T06:44:01.253ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }
3782025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-02-28T06:44:01.262ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-02-28T06:44:01.266ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
3862025-02-28T06:44:01.303ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872025-02-28T06:44:01.310ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone file = sled-storage/src/dataset.rs:302
3882025-02-28T06:44:01.478ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a file = sled-storage/src/dataset.rs:388
3892025-02-28T06:44:01.486ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902025-02-28T06:44:01.486ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912025-02-28T06:44:01.486ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922025-02-28T06:44:01.486ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932025-02-28T06:44:01.486ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942025-02-28T06:44:01.497ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952025-02-28T06:44:01.497ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool)
3962025-02-28T06:44:01.611ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }
3972025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-02-28T06:44:01.620ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042025-02-28T06:44:01.661ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052025-02-28T06:44:01.669ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone file = sled-storage/src/dataset.rs:302
4062025-02-28T06:44:01.837ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4 file = sled-storage/src/dataset.rs:388
4072025-02-28T06:44:01.845ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082025-02-28T06:44:01.845ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092025-02-28T06:44:01.845ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102025-02-28T06:44:01.845ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112025-02-28T06:44:01.845ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122025-02-28T06:44:01.855ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132025-02-28T06:44:01.855ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 574faf87-fd2d-44c5-bef4-135771b1853a (zpool)
4142025-02-28T06:44:01.966ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }
4152025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-02-28T06:44:01.973ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222025-02-28T06:44:02.012ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232025-02-28T06:44:02.022ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crypt/zone file = sled-storage/src/dataset.rs:302
4242025-02-28T06:44:02.193ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_574faf87-fd2d-44c5-bef4-135771b1853a file = sled-storage/src/dataset.rs:388
4252025-02-28T06:44:02.201ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-02-28T06:44:02.201ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-02-28T06:44:02.201ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-02-28T06:44:02.201ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3be6427-4bf0-4318-b160-a3ae7a69e6ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b076552-73aa-4fa4-8a89-0399e8a1ec96 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-02-28T06:44:02.202ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-02-28T06:44:02.202ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-02-28T06:44:02.202ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4332025-02-28T06:44:02.202ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4352025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4362025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4372025-02-28T06:44:02.202ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4382025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4392025-02-28T06:44:02.202ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-02-28T06:44:02.202ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4412025-02-28T06:44:02.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3534842 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43976 req_id = 6d3d0bbb-130a-4c9d-b8a8-cca943772600 response_code = 200 uri = /omicron-physical-disks
4422025-02-28T06:44:02.234ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0fa0bedb-a3b9-4459-bd96-b2b56faff1be (dataset): DatasetConfig { id: 0fa0bedb-a3b9-4459-bd96-b2b56faff1be (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10373fc9-56c4-4d77-8324-7c81649fca7f (dataset): DatasetConfig { id: 10373fc9-56c4-4d77-8324-7c81649fca7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e63084-48c0-4840-bf78-cee22c05950e (dataset): DatasetConfig { id: 11e63084-48c0-4840-bf78-cee22c05950e (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13734c30-138f-4d5f-afd8-cf93ac0c44f0 (dataset): DatasetConfig { id: 13734c30-138f-4d5f-afd8-cf93ac0c44f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 154920b9-917e-4d7d-99d8-eaef6c80441d (dataset): DatasetConfig { id: 154920b9-917e-4d7d-99d8-eaef6c80441d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 189850d3-643e-4371-8036-b934048730da (dataset): DatasetConfig { id: 189850d3-643e-4371-8036-b934048730da (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c495f42-6858-4290-910c-69adc050b7c7 (dataset): DatasetConfig { id: 1c495f42-6858-4290-910c-69adc050b7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c8e341b-196c-4f1e-8bcb-dcdef5fc413b (dataset): DatasetConfig { id: 1c8e341b-196c-4f1e-8bcb-dcdef5fc413b (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ccbd1a5-3ae3-4361-8007-6ee64cd53f7d (dataset): DatasetConfig { id: 1ccbd1a5-3ae3-4361-8007-6ee64cd53f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21f9ad0b-7904-4111-8d6b-95c96e46ee0f (dataset): DatasetConfig { id: 21f9ad0b-7904-4111-8d6b-95c96e46ee0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 258391dd-8ff6-4950-9364-a04f319bdedc (dataset): DatasetConfig { id: 258391dd-8ff6-4950-9364-a04f319bdedc (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 264496b2-3e18-4fef-960e-acdf72791a31 (dataset): DatasetConfig { id: 264496b2-3e18-4fef-960e-acdf72791a31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a4cf47c-affc-4ed9-9a4c-1b04df7b8e31 (dataset): DatasetConfig { id: 3a4cf47c-affc-4ed9-9a4c-1b04df7b8e31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a5a2f9f-1a3b-4368-9f92-d0a6e0f75765 (dataset): DatasetConfig { id: 3a5a2f9f-1a3b-4368-9f92-d0a6e0f75765 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3ee37f2c-e146-402d-ac60-42adab4040d4 (dataset): DatasetConfig { id: 3ee37f2c-e146-402d-ac60-42adab4040d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 411e039d-c1f6-4442-9c8b-41c0968603a5 (dataset): DatasetConfig { id: 411e039d-c1f6-4442-9c8b-41c0968603a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 448da3f8-bea7-430f-a08b-2df9fb21a629 (dataset): DatasetConfig { id: 448da3f8-bea7-430f-a08b-2df9fb21a629 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4744623f-674f-4315-8343-fcfbd43b9d95 (dataset): DatasetConfig { id: 4744623f-674f-4315-8343-fcfbd43b9d95 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d0511a8-4105-4246-b63c-d7bf45812f74 (dataset): DatasetConfig { id: 4d0511a8-4105-4246-b63c-d7bf45812f74 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4dc314c9-952a-4369-a917-fdf3509e11fe (dataset): DatasetConfig { id: 4dc314c9-952a-4369-a917-fdf3509e11fe (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 509e9f22-a141-4bde-b276-8f25c0a89676 (dataset): DatasetConfig { id: 509e9f22-a141-4bde-b276-8f25c0a89676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5209e3be-40b6-4202-b1d7-108523dffc18 (dataset): DatasetConfig { id: 5209e3be-40b6-4202-b1d7-108523dffc18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52c13f6e-b5bb-4e80-a2c1-113e115d05f2 (dataset): DatasetConfig { id: 52c13f6e-b5bb-4e80-a2c1-113e115d05f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d47b2f8-c81d-4de0-9d76-c00d85610570 (dataset): DatasetConfig { id: 5d47b2f8-c81d-4de0-9d76-c00d85610570 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f39889b-ec21-4206-bb7b-d6aca07a9bed (dataset): DatasetConfig { id: 5f39889b-ec21-4206-bb7b-d6aca07a9bed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f7d8077-41ee-40d5-a628-9bbac198abdf (dataset): DatasetConfig { id: 5f7d8077-41ee-40d5-a628-9bbac198abdf (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fdbc27c-5a03-4f0b-8ca6-226ef48383ea (dataset): DatasetConfig { id: 5fdbc27c-5a03-4f0b-8ca6-226ef48383ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61367fe4-c1a4-4885-aa91-3cc9ea7dc695 (dataset): DatasetConfig { id: 61367fe4-c1a4-4885-aa91-3cc9ea7dc695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6478bda1-6381-48d0-b667-b9e5db17b7a3 (dataset): DatasetConfig { id: 6478bda1-6381-48d0-b667-b9e5db17b7a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f2d980d-82e9-4673-987e-c2b852d21a7d (dataset): DatasetConfig { id: 6f2d980d-82e9-4673-987e-c2b852d21a7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 729b69f4-c24e-4c70-86fa-687978ef3807 (dataset): DatasetConfig { id: 729b69f4-c24e-4c70-86fa-687978ef3807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72a563dd-9d5d-4e4c-9ab0-060397780dc3 (dataset): DatasetConfig { id: 72a563dd-9d5d-4e4c-9ab0-060397780dc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a4573a2-8c38-470e-a4ea-e98d440bf646 (dataset): DatasetConfig { id: 7a4573a2-8c38-470e-a4ea-e98d440bf646 (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bf63ccc-6431-4c71-9833-1eb2d999a65f (dataset): DatasetConfig { id: 7bf63ccc-6431-4c71-9833-1eb2d999a65f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88a7d30b-78f0-4b3d-8417-e3783fb9438e (dataset): DatasetConfig { id: 88a7d30b-78f0-4b3d-8417-e3783fb9438e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88e13aa4-da23-4aa2-90b5-4f16b26b2510 (dataset): DatasetConfig { id: 88e13aa4-da23-4aa2-90b5-4f16b26b2510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89d90edb-878c-4def-a96a-c2fbe225d28e (dataset): DatasetConfig { id: 89d90edb-878c-4def-a96a-c2fbe225d28e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916508c9-a884-4f9b-a92d-37d789bfc7f0 (dataset): DatasetConfig { id: 916508c9-a884-4f9b-a92d-37d789bfc7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 934b58f0-3bba-419d-814b-adc41a98fbb8 (dataset): DatasetConfig { id: 934b58f0-3bba-419d-814b-adc41a98fbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9547c84d-05fe-4d7b-92ab-55482e5d2dec (dataset): DatasetConfig { id: 9547c84d-05fe-4d7b-92ab-55482e5d2dec (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98f71c97-3acc-4725-8786-430b41d17a1c (dataset): DatasetConfig { id: 98f71c97-3acc-4725-8786-430b41d17a1c (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99557e4b-2cd5-489f-a961-332371fbb7d2 (dataset): DatasetConfig { id: 99557e4b-2cd5-489f-a961-332371fbb7d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ae5ed35-596c-46ab-8932-06a32289c2be (dataset): DatasetConfig { id: 9ae5ed35-596c-46ab-8932-06a32289c2be (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9df5062c-2c17-43d7-843f-391bc7a0d8cd (dataset): DatasetConfig { id: 9df5062c-2c17-43d7-843f-391bc7a0d8cd (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0055e9d-d07d-475b-aba4-ec067c447b9f (dataset): DatasetConfig { id: a0055e9d-d07d-475b-aba4-ec067c447b9f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a15ccddf-2d60-4624-99a2-3609399fa168 (dataset): DatasetConfig { id: a15ccddf-2d60-4624-99a2-3609399fa168 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3ee4fd6-eab1-486b-941f-1fa05478c44a (dataset): DatasetConfig { id: a3ee4fd6-eab1-486b-941f-1fa05478c44a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7833c41-bbe0-4999-8849-b12764aaa4a3 (dataset): DatasetConfig { id: a7833c41-bbe0-4999-8849-b12764aaa4a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8442c15-9b9b-4e92-9bdd-db6fac263824 (dataset): DatasetConfig { id: a8442c15-9b9b-4e92-9bdd-db6fac263824 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b29f0eca-5f03-4e09-aa38-4e4cbbfbbfd7 (dataset): DatasetConfig { id: b29f0eca-5f03-4e09-aa38-4e4cbbfbbfd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b454c241-1153-43b4-97dc-ec3bb9da56fa (dataset): DatasetConfig { id: b454c241-1153-43b4-97dc-ec3bb9da56fa (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6b4f20e-7130-4b08-b860-b628b6d2ffc6 (dataset): DatasetConfig { id: b6b4f20e-7130-4b08-b860-b628b6d2ffc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4f24ded-997e-4afd-9455-ad45fad3f3c1 (dataset): DatasetConfig { id: c4f24ded-997e-4afd-9455-ad45fad3f3c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c518ad42-fb6a-485e-a74a-97908d2409a2 (dataset): DatasetConfig { id: c518ad42-fb6a-485e-a74a-97908d2409a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c72169d5-e0ff-4b48-bb0b-ca49140d3aba (dataset): DatasetConfig { id: c72169d5-e0ff-4b48-bb0b-ca49140d3aba (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb6f0dff-3bd6-40d9-adb2-c8f086937a56 (dataset): DatasetConfig { id: cb6f0dff-3bd6-40d9-adb2-c8f086937a56 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d132ec74-353c-4978-aa52-757c9484a40d (dataset): DatasetConfig { id: d132ec74-353c-4978-aa52-757c9484a40d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9ef8c45-ef99-4970-af11-52ce9a4b56ad (dataset): DatasetConfig { id: d9ef8c45-ef99-4970-af11-52ce9a4b56ad (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da46db98-ee66-42ba-9a2f-f09aa8c343d8 (dataset): DatasetConfig { id: da46db98-ee66-42ba-9a2f-f09aa8c343d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb45be6-c985-41f9-aeb5-07b469ff95fb (dataset): DatasetConfig { id: dbb45be6-c985-41f9-aeb5-07b469ff95fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e07521e7-1288-495a-9fea-00a55a02ffbc (dataset): DatasetConfig { id: e07521e7-1288-495a-9fea-00a55a02ffbc (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7fe020e-c4ab-4403-9e0b-5b586f0a8b1b (dataset): DatasetConfig { id: e7fe020e-c4ab-4403-9e0b-5b586f0a8b1b (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e99b857e-fe63-4b33-b7b1-6e633fdf3ee0 (dataset): DatasetConfig { id: e99b857e-fe63-4b33-b7b1-6e633fdf3ee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefa7eea-78e2-4740-ac11-5ad5f260e5e7 (dataset): DatasetConfig { id: eefa7eea-78e2-4740-ac11-5ad5f260e5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef5fc3be-e61b-4886-a272-7f6e581406a7 (dataset): DatasetConfig { id: ef5fc3be-e61b-4886-a272-7f6e581406a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc0cc736-343f-4041-9750-952f0e41aa44 (dataset): DatasetConfig { id: fc0cc736-343f-4041-9750-952f0e41aa44 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432025-02-28T06:44:02.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46671
4442025-02-28T06:44:02.234ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4452025-02-28T06:44:02.234ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0fa0bedb-a3b9-4459-bd96-b2b56faff1be (dataset): DatasetConfig { id: 0fa0bedb-a3b9-4459-bd96-b2b56faff1be (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10373fc9-56c4-4d77-8324-7c81649fca7f (dataset): DatasetConfig { id: 10373fc9-56c4-4d77-8324-7c81649fca7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e63084-48c0-4840-bf78-cee22c05950e (dataset): DatasetConfig { id: 11e63084-48c0-4840-bf78-cee22c05950e (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13734c30-138f-4d5f-afd8-cf93ac0c44f0 (dataset): DatasetConfig { id: 13734c30-138f-4d5f-afd8-cf93ac0c44f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 154920b9-917e-4d7d-99d8-eaef6c80441d (dataset): DatasetConfig { id: 154920b9-917e-4d7d-99d8-eaef6c80441d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 189850d3-643e-4371-8036-b934048730da (dataset): DatasetConfig { id: 189850d3-643e-4371-8036-b934048730da (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c495f42-6858-4290-910c-69adc050b7c7 (dataset): DatasetConfig { id: 1c495f42-6858-4290-910c-69adc050b7c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c8e341b-196c-4f1e-8bcb-dcdef5fc413b (dataset): DatasetConfig { id: 1c8e341b-196c-4f1e-8bcb-dcdef5fc413b (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ccbd1a5-3ae3-4361-8007-6ee64cd53f7d (dataset): DatasetConfig { id: 1ccbd1a5-3ae3-4361-8007-6ee64cd53f7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21f9ad0b-7904-4111-8d6b-95c96e46ee0f (dataset): DatasetConfig { id: 21f9ad0b-7904-4111-8d6b-95c96e46ee0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 258391dd-8ff6-4950-9364-a04f319bdedc (dataset): DatasetConfig { id: 258391dd-8ff6-4950-9364-a04f319bdedc (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 264496b2-3e18-4fef-960e-acdf72791a31 (dataset): DatasetConfig { id: 264496b2-3e18-4fef-960e-acdf72791a31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a4cf47c-affc-4ed9-9a4c-1b04df7b8e31 (dataset): DatasetConfig { id: 3a4cf47c-affc-4ed9-9a4c-1b04df7b8e31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a5a2f9f-1a3b-4368-9f92-d0a6e0f75765 (dataset): DatasetConfig { id: 3a5a2f9f-1a3b-4368-9f92-d0a6e0f75765 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3ee37f2c-e146-402d-ac60-42adab4040d4 (dataset): DatasetConfig { id: 3ee37f2c-e146-402d-ac60-42adab4040d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 411e039d-c1f6-4442-9c8b-41c0968603a5 (dataset): DatasetConfig { id: 411e039d-c1f6-4442-9c8b-41c0968603a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 448da3f8-bea7-430f-a08b-2df9fb21a629 (dataset): DatasetConfig { id: 448da3f8-bea7-430f-a08b-2df9fb21a629 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4744623f-674f-4315-8343-fcfbd43b9d95 (dataset): DatasetConfig { id: 4744623f-674f-4315-8343-fcfbd43b9d95 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d0511a8-4105-4246-b63c-d7bf45812f74 (dataset): DatasetConfig { id: 4d0511a8-4105-4246-b63c-d7bf45812f74 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4dc314c9-952a-4369-a917-fdf3509e11fe (dataset): DatasetConfig { id: 4dc314c9-952a-4369-a917-fdf3509e11fe (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 509e9f22-a141-4bde-b276-8f25c0a89676 (dataset): DatasetConfig { id: 509e9f22-a141-4bde-b276-8f25c0a89676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5209e3be-40b6-4202-b1d7-108523dffc18 (dataset): DatasetConfig { id: 5209e3be-40b6-4202-b1d7-108523dffc18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52c13f6e-b5bb-4e80-a2c1-113e115d05f2 (dataset): DatasetConfig { id: 52c13f6e-b5bb-4e80-a2c1-113e115d05f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d47b2f8-c81d-4de0-9d76-c00d85610570 (dataset): DatasetConfig { id: 5d47b2f8-c81d-4de0-9d76-c00d85610570 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f39889b-ec21-4206-bb7b-d6aca07a9bed (dataset): DatasetConfig { id: 5f39889b-ec21-4206-bb7b-d6aca07a9bed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f7d8077-41ee-40d5-a628-9bbac198abdf (dataset): DatasetConfig { id: 5f7d8077-41ee-40d5-a628-9bbac198abdf (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5fdbc27c-5a03-4f0b-8ca6-226ef48383ea (dataset): DatasetConfig { id: 5fdbc27c-5a03-4f0b-8ca6-226ef48383ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61367fe4-c1a4-4885-aa91-3cc9ea7dc695 (dataset): DatasetConfig { id: 61367fe4-c1a4-4885-aa91-3cc9ea7dc695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6478bda1-6381-48d0-b667-b9e5db17b7a3 (dataset): DatasetConfig { id: 6478bda1-6381-48d0-b667-b9e5db17b7a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f2d980d-82e9-4673-987e-c2b852d21a7d (dataset): DatasetConfig { id: 6f2d980d-82e9-4673-987e-c2b852d21a7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 729b69f4-c24e-4c70-86fa-687978ef3807 (dataset): DatasetConfig { id: 729b69f4-c24e-4c70-86fa-687978ef3807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72a563dd-9d5d-4e4c-9ab0-060397780dc3 (dataset): DatasetConfig { id: 72a563dd-9d5d-4e4c-9ab0-060397780dc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a4573a2-8c38-470e-a4ea-e98d440bf646 (dataset): DatasetConfig { id: 7a4573a2-8c38-470e-a4ea-e98d440bf646 (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bf63ccc-6431-4c71-9833-1eb2d999a65f (dataset): DatasetConfig { id: 7bf63ccc-6431-4c71-9833-1eb2d999a65f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88a7d30b-78f0-4b3d-8417-e3783fb9438e (dataset): DatasetConfig { id: 88a7d30b-78f0-4b3d-8417-e3783fb9438e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88e13aa4-da23-4aa2-90b5-4f16b26b2510 (dataset): DatasetConfig { id: 88e13aa4-da23-4aa2-90b5-4f16b26b2510 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89d90edb-878c-4def-a96a-c2fbe225d28e (dataset): DatasetConfig { id: 89d90edb-878c-4def-a96a-c2fbe225d28e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 916508c9-a884-4f9b-a92d-37d789bfc7f0 (dataset): DatasetConfig { id: 916508c9-a884-4f9b-a92d-37d789bfc7f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 934b58f0-3bba-419d-814b-adc41a98fbb8 (dataset): DatasetConfig { id: 934b58f0-3bba-419d-814b-adc41a98fbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9547c84d-05fe-4d7b-92ab-55482e5d2dec (dataset): DatasetConfig { id: 9547c84d-05fe-4d7b-92ab-55482e5d2dec (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98f71c97-3acc-4725-8786-430b41d17a1c (dataset): DatasetConfig { id: 98f71c97-3acc-4725-8786-430b41d17a1c (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99557e4b-2cd5-489f-a961-332371fbb7d2 (dataset): DatasetConfig { id: 99557e4b-2cd5-489f-a961-332371fbb7d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ae5ed35-596c-46ab-8932-06a32289c2be (dataset): DatasetConfig { id: 9ae5ed35-596c-46ab-8932-06a32289c2be (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9df5062c-2c17-43d7-843f-391bc7a0d8cd (dataset): DatasetConfig { id: 9df5062c-2c17-43d7-843f-391bc7a0d8cd (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0055e9d-d07d-475b-aba4-ec067c447b9f (dataset): DatasetConfig { id: a0055e9d-d07d-475b-aba4-ec067c447b9f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a15ccddf-2d60-4624-99a2-3609399fa168 (dataset): DatasetConfig { id: a15ccddf-2d60-4624-99a2-3609399fa168 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3ee4fd6-eab1-486b-941f-1fa05478c44a (dataset): DatasetConfig { id: a3ee4fd6-eab1-486b-941f-1fa05478c44a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7833c41-bbe0-4999-8849-b12764aaa4a3 (dataset): DatasetConfig { id: a7833c41-bbe0-4999-8849-b12764aaa4a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8442c15-9b9b-4e92-9bdd-db6fac263824 (dataset): DatasetConfig { id: a8442c15-9b9b-4e92-9bdd-db6fac263824 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b29f0eca-5f03-4e09-aa38-4e4cbbfbbfd7 (dataset): DatasetConfig { id: b29f0eca-5f03-4e09-aa38-4e4cbbfbbfd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b454c241-1153-43b4-97dc-ec3bb9da56fa (dataset): DatasetConfig { id: b454c241-1153-43b4-97dc-ec3bb9da56fa (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6b4f20e-7130-4b08-b860-b628b6d2ffc6 (dataset): DatasetConfig { id: b6b4f20e-7130-4b08-b860-b628b6d2ffc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4f24ded-997e-4afd-9455-ad45fad3f3c1 (dataset): DatasetConfig { id: c4f24ded-997e-4afd-9455-ad45fad3f3c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c518ad42-fb6a-485e-a74a-97908d2409a2 (dataset): DatasetConfig { id: c518ad42-fb6a-485e-a74a-97908d2409a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c72169d5-e0ff-4b48-bb0b-ca49140d3aba (dataset): DatasetConfig { id: c72169d5-e0ff-4b48-bb0b-ca49140d3aba (dataset), name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb6f0dff-3bd6-40d9-adb2-c8f086937a56 (dataset): DatasetConfig { id: cb6f0dff-3bd6-40d9-adb2-c8f086937a56 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d132ec74-353c-4978-aa52-757c9484a40d (dataset): DatasetConfig { id: d132ec74-353c-4978-aa52-757c9484a40d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9ef8c45-ef99-4970-af11-52ce9a4b56ad (dataset): DatasetConfig { id: d9ef8c45-ef99-4970-af11-52ce9a4b56ad (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da46db98-ee66-42ba-9a2f-f09aa8c343d8 (dataset): DatasetConfig { id: da46db98-ee66-42ba-9a2f-f09aa8c343d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb45be6-c985-41f9-aeb5-07b469ff95fb (dataset): DatasetConfig { id: dbb45be6-c985-41f9-aeb5-07b469ff95fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e07521e7-1288-495a-9fea-00a55a02ffbc (dataset): DatasetConfig { id: e07521e7-1288-495a-9fea-00a55a02ffbc (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7fe020e-c4ab-4403-9e0b-5b586f0a8b1b (dataset): DatasetConfig { id: e7fe020e-c4ab-4403-9e0b-5b586f0a8b1b (dataset), name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e99b857e-fe63-4b33-b7b1-6e633fdf3ee0 (dataset): DatasetConfig { id: e99b857e-fe63-4b33-b7b1-6e633fdf3ee0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eefa7eea-78e2-4740-ac11-5ad5f260e5e7 (dataset): DatasetConfig { id: eefa7eea-78e2-4740-ac11-5ad5f260e5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef5fc3be-e61b-4886-a272-7f6e581406a7 (dataset): DatasetConfig { id: ef5fc3be-e61b-4886-a272-7f6e581406a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc0cc736-343f-4041-9750-952f0e41aa44 (dataset): DatasetConfig { id: fc0cc736-343f-4041-9750-952f0e41aa44 (dataset), name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-02-28T06:44:02.234ZINFOSledAgent (StorageManager): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-02-28T06:44:02.234ZINFOSledAgent (StorageManager): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-02-28T06:44:02.234ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-02-28T06:44:02.250ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-02-28T06:44:02.250ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-02-28T06:44:02.250ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350" } file = sled-storage/src/manager.rs:1431
4522025-02-28T06:44:02.268ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
4532025-02-28T06:44:02.324ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-02-28T06:44:02.324ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552025-02-28T06:44:02.324ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a" } file = sled-storage/src/manager.rs:1431
4562025-02-28T06:44:02.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-02-28T06:44:02.400ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-02-28T06:44:02.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92" } file = sled-storage/src/manager.rs:1431
4592025-02-28T06:44:02.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-02-28T06:44:02.474ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-02-28T06:44:02.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crucible" } file = sled-storage/src/manager.rs:1431
4622025-02-28T06:44:02.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-02-28T06:44:02.539ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4642025-02-28T06:44:02.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4652025-02-28T06:44:02.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-02-28T06:44:02.579ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672025-02-28T06:44:02.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crucible" } file = sled-storage/src/manager.rs:1431
4682025-02-28T06:44:02.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-02-28T06:44:02.647ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702025-02-28T06:44:02.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4712025-02-28T06:44:02.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-02-28T06:44:02.716ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732025-02-28T06:44:02.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone/oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), full_name: "oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone/oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9" } file = sled-storage/src/manager.rs:1431
4742025-02-28T06:44:02.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-02-28T06:44:02.791ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-02-28T06:44:02.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34" } file = sled-storage/src/manager.rs:1431
4772025-02-28T06:44:02.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-02-28T06:44:02.867ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-02-28T06:44:02.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone" } file = sled-storage/src/manager.rs:1431
4802025-02-28T06:44:02.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-02-28T06:44:02.908ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4822025-02-28T06:44:02.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/debug"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4832025-02-28T06:44:02.947ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-02-28T06:44:02.947ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-02-28T06:44:02.947ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4862025-02-28T06:44:03.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-02-28T06:44:03.013ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-02-28T06:44:03.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4892025-02-28T06:44:03.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-02-28T06:44:03.082ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4912025-02-28T06:44:03.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/debug"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/debug" } file = sled-storage/src/manager.rs:1431
4922025-02-28T06:44:03.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-02-28T06:44:03.121ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4942025-02-28T06:44:03.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/debug"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/debug" } file = sled-storage/src/manager.rs:1431
4952025-02-28T06:44:03.162ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-02-28T06:44:03.162ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-02-28T06:44:03.162ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone/oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8"), full_name: "oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone/oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8" } file = sled-storage/src/manager.rs:1431
4982025-02-28T06:44:03.237ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-02-28T06:44:03.237ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5002025-02-28T06:44:03.237ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/debug"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/debug" } file = sled-storage/src/manager.rs:1431
5012025-02-28T06:44:03.270ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
5022025-02-28T06:44:03.275ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-02-28T06:44:03.275ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-02-28T06:44:03.275ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5052025-02-28T06:44:03.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-02-28T06:44:03.345ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5072025-02-28T06:44:03.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/debug"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5082025-02-28T06:44:03.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-02-28T06:44:03.387ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102025-02-28T06:44:03.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3" } file = sled-storage/src/manager.rs:1431
5112025-02-28T06:44:03.475ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-02-28T06:44:03.475ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132025-02-28T06:44:03.475ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5142025-02-28T06:44:03.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-02-28T06:44:03.552ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162025-02-28T06:44:03.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547" } file = sled-storage/src/manager.rs:1431
5172025-02-28T06:44:03.636ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-02-28T06:44:03.636ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192025-02-28T06:44:03.636ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5202025-02-28T06:44:03.694ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-02-28T06:44:03.694ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222025-02-28T06:44:03.694ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0" } file = sled-storage/src/manager.rs:1431
5232025-02-28T06:44:03.755ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-02-28T06:44:03.755ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-02-28T06:44:03.755ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crucible" } file = sled-storage/src/manager.rs:1431
5262025-02-28T06:44:03.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-02-28T06:44:03.817ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5282025-02-28T06:44:03.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone"), full_name: "oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5292025-02-28T06:44:03.856ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-02-28T06:44:03.856ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-02-28T06:44:03.856ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98" } file = sled-storage/src/manager.rs:1431
5322025-02-28T06:44:03.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-02-28T06:44:03.919ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5342025-02-28T06:44:03.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/debug"), full_name: "oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/debug" } file = sled-storage/src/manager.rs:1431
5352025-02-28T06:44:03.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-02-28T06:44:03.951ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-02-28T06:44:03.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5382025-02-28T06:44:04.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-02-28T06:44:04.018ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5402025-02-28T06:44:04.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/574faf87-fd2d-44c5-bef4-135771b1853a/crypt/debug"), full_name: "oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5412025-02-28T06:44:04.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-02-28T06:44:04.059ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-02-28T06:44:04.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/574faf87-fd2d-44c5-bef4-135771b1853a/crypt/zone/oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468"), full_name: "oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crypt/zone/oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468" } file = sled-storage/src/manager.rs:1431
5442025-02-28T06:44:04.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-02-28T06:44:04.132ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-02-28T06:44:04.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069" } file = sled-storage/src/manager.rs:1431
5472025-02-28T06:44:04.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-02-28T06:44:04.205ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-02-28T06:44:04.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone/oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5"), full_name: "oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone/oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5" } file = sled-storage/src/manager.rs:1431
5502025-02-28T06:44:04.273ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
5512025-02-28T06:44:04.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-02-28T06:44:04.279ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5532025-02-28T06:44:04.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5542025-02-28T06:44:04.315ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-02-28T06:44:04.315ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-02-28T06:44:04.315ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0" } file = sled-storage/src/manager.rs:1431
5572025-02-28T06:44:04.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-02-28T06:44:04.392ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-02-28T06:44:04.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7" } file = sled-storage/src/manager.rs:1431
5602025-02-28T06:44:04.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-02-28T06:44:04.464ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622025-02-28T06:44:04.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2" } file = sled-storage/src/manager.rs:1431
5632025-02-28T06:44:04.538ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-02-28T06:44:04.538ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-02-28T06:44:04.538ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crucible" } file = sled-storage/src/manager.rs:1431
5662025-02-28T06:44:04.600ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-02-28T06:44:04.600ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-02-28T06:44:04.600ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5692025-02-28T06:44:04.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-02-28T06:44:04.664ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5712025-02-28T06:44:04.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/574faf87-fd2d-44c5-bef4-135771b1853a/crypt/zone"), full_name: "oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5722025-02-28T06:44:04.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-02-28T06:44:04.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-02-28T06:44:04.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone/oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d"), full_name: "oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/zone/oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d" } file = sled-storage/src/manager.rs:1431
5752025-02-28T06:44:04.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-02-28T06:44:04.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-02-28T06:44:04.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/zone/oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4"), full_name: "oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/zone/oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4" } file = sled-storage/src/manager.rs:1431
5782025-02-28T06:44:04.851ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-02-28T06:44:04.851ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5802025-02-28T06:44:04.851ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/debug"), full_name: "oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5812025-02-28T06:44:04.888ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-02-28T06:44:04.888ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5832025-02-28T06:44:04.888ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone"), full_name: "oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5842025-02-28T06:44:04.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-02-28T06:44:04.928ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-02-28T06:44:04.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c" } file = sled-storage/src/manager.rs:1431
5872025-02-28T06:44:05.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-02-28T06:44:05.001ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-02-28T06:44:05.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26" } file = sled-storage/src/manager.rs:1431
5902025-02-28T06:44:05.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-02-28T06:44:05.075ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-02-28T06:44:05.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/zone/oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222" } file = sled-storage/src/manager.rs:1431
5932025-02-28T06:44:05.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-02-28T06:44:05.149ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5952025-02-28T06:44:05.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5962025-02-28T06:44:05.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-02-28T06:44:05.187ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982025-02-28T06:44:05.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be" } file = sled-storage/src/manager.rs:1431
5992025-02-28T06:44:05.261ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-02-28T06:44:05.261ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-02-28T06:44:05.261ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crucible" } file = sled-storage/src/manager.rs:1431
6022025-02-28T06:44:05.275ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6032025-02-28T06:44:05.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-02-28T06:44:05.322ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052025-02-28T06:44:05.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/zone/oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c" } file = sled-storage/src/manager.rs:1431
6062025-02-28T06:44:05.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-02-28T06:44:05.398ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-02-28T06:44:05.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6092025-02-28T06:44:05.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-02-28T06:44:05.459ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-02-28T06:44:05.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crucible" } file = sled-storage/src/manager.rs:1431
6122025-02-28T06:44:05.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-02-28T06:44:05.519ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-02-28T06:44:05.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crucible" } file = sled-storage/src/manager.rs:1431
6152025-02-28T06:44:05.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-02-28T06:44:05.582ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-02-28T06:44:05.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1"), full_name: "oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crypt/zone/oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1" } file = sled-storage/src/manager.rs:1431
6182025-02-28T06:44:05.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-02-28T06:44:05.661ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-02-28T06:44:05.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf" } file = sled-storage/src/manager.rs:1431
6212025-02-28T06:44:05.735ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-02-28T06:44:05.736ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6232025-02-28T06:44:05.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone" } file = sled-storage/src/manager.rs:1431
6242025-02-28T06:44:05.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-02-28T06:44:05.772ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-02-28T06:44:05.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a" } file = sled-storage/src/manager.rs:1431
6272025-02-28T06:44:05.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-02-28T06:44:05.844ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-02-28T06:44:05.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6302025-02-28T06:44:05.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-02-28T06:44:05.908ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322025-02-28T06:44:05.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b"), full_name: "oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/zone/oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b" } file = sled-storage/src/manager.rs:1431
6332025-02-28T06:44:05.980ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-02-28T06:44:05.980ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-02-28T06:44:05.980ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crucible" } file = sled-storage/src/manager.rs:1431
6362025-02-28T06:44:06.002ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 18.153204656s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6372025-02-28T06:44:06.041ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-02-28T06:44:06.041ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-02-28T06:44:06.041ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6402025-02-28T06:44:06.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-02-28T06:44:06.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-02-28T06:44:06.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crucible" } file = sled-storage/src/manager.rs:1431
6432025-02-28T06:44:06.169ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-02-28T06:44:06.169ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6452025-02-28T06:44:06.169ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/zone"), full_name: "oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/zone" } file = sled-storage/src/manager.rs:1431
6462025-02-28T06:44:06.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-02-28T06:44:06.210ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6482025-02-28T06:44:06.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/debug"), full_name: "oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6492025-02-28T06:44:06.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-02-28T06:44:06.247ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512025-02-28T06:44:06.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21"), full_name: "oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/zone/oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21" } file = sled-storage/src/manager.rs:1431
6522025-02-28T06:44:06.278ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6532025-02-28T06:44:06.324ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542025-02-28T06:44:06.324ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-02-28T06:44:06.324ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6562025-02-28T06:44:06.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4090794 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46671 req_id = f0cb3714-c9c0-459b-82a6-d346b8641c76 response_code = 200 uri = /datasets
6572025-02-28T06:44:06.357ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6582025-02-28T06:44:06.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58955
6592025-02-28T06:44:06.357ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-02-28T06:44:06.357ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-02-28T06:44:06.368ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-02-28T06:44:06.368ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-02-28T06:44:06.384ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-02-28T06:44:06.384ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-02-28T06:44:06.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-02-28T06:44:06.393ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:188
6672025-02-28T06:44:06.393ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-02-28T06:44:06.393ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6692025-02-28T06:44:06.393ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-02-28T06:44:06.436ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-02-28T06:44:06.436ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-02-28T06:44:06.436ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-02-28T06:44:06.495ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069 file = illumos-utils/src/zone.rs:325
6742025-02-28T06:44:06.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf file = illumos-utils/src/zone.rs:325
6752025-02-28T06:44:06.503ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 file = illumos-utils/src/zone.rs:325
6762025-02-28T06:44:06.517ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069 file = illumos-utils/src/zone.rs:363
6772025-02-28T06:44:06.522ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf file = illumos-utils/src/zone.rs:363
6782025-02-28T06:44:06.526ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 file = illumos-utils/src/zone.rs:363
6792025-02-28T06:44:07.279ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/probe_manager.rs:238 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6802025-02-28T06:44:08.125ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
6812025-02-28T06:44:08.125ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
6822025-02-28T06:44:08.131ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
6832025-02-28T06:44:08.131ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
6842025-02-28T06:44:08.254ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852025-02-28T06:44:08.254ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6862025-02-28T06:44:08.254ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
6872025-02-28T06:44:08.263ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15629259735442405665 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6882025-02-28T06:44:08.265ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14917665648467173261 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
6892025-02-28T06:44:08.294ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
6902025-02-28T06:44:08.294ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
6912025-02-28T06:44:08.337ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
6922025-02-28T06:44:08.337ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
6932025-02-28T06:44:08.387ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
6942025-02-28T06:44:08.387ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
6952025-02-28T06:44:08.408ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
6962025-02-28T06:44:08.409ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
6972025-02-28T06:44:08.516ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
6982025-02-28T06:44:08.517ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
6992025-02-28T06:44:08.694ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7002025-02-28T06:44:08.694ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7012025-02-28T06:44:08.741ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7022025-02-28T06:44:08.741ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7032025-02-28T06:44:08.811ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7042025-02-28T06:44:08.811ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7052025-02-28T06:44:08.817ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17265187205636014471 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
7062025-02-28T06:44:08.817ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15778910903206655046 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
7072025-02-28T06:44:08.843ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9) file = sled-agent/src/nexus.rs:530 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
7082025-02-28T06:44:08.844ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7092025-02-28T06:44:08.876ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7102025-02-28T06:44:08.876ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7112025-02-28T06:44:08.876ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7122025-02-28T06:44:08.876ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7132025-02-28T06:44:08.914ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7142025-02-28T06:44:08.968ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7152025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7162025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7172025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7182025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7192025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7202025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7212025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7222025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7232025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7242025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7252025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7262025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7272025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7282025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7292025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7302025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7312025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7322025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7332025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7342025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7352025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7362025-02-28T06:44:08.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7372025-02-28T06:44:09.229ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7382025-02-28T06:44:09.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 73.362469ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7392025-02-28T06:44:09.237ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7402025-02-28T06:44:09.241ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7412025-02-28T06:44:09.241ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7422025-02-28T06:44:09.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 67.548632ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7432025-02-28T06:44:09.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 65.247938ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7442025-02-28T06:44:09.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 36.620493ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7452025-02-28T06:44:09.398ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 144.307611ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7462025-02-28T06:44:09.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 97.305111ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7472025-02-28T06:44:09.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 53.342042ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7482025-02-28T06:44:09.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 163.684361ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7492025-02-28T06:44:09.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 381.946228ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7502025-02-28T06:44:09.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 280.345233ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7512025-02-28T06:44:09.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 465.883072ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7522025-02-28T06:44:09.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 226.191848ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7532025-02-28T06:44:09.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 791.984502ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7542025-02-28T06:44:10.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 1.003659417s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7552025-02-28T06:44:10.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 597.726277ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7562025-02-28T06:44:10.784ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 761.515704ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7572025-02-28T06:44:10.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 555.84604ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7582025-02-28T06:44:11.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 1.256408392s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7592025-02-28T06:44:11.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 1.255497934s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7602025-02-28T06:44:11.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 553.1849ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7612025-02-28T06:44:12.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 1.334909189s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7622025-02-28T06:44:12.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 996.416595ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7632025-02-28T06:44:12.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 754.052196ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7642025-02-28T06:44:13.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069") failed: Property not found. retry in 1.259513948s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7652025-02-28T06:44:13.465ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf") failed: Property not found. retry in 1.29874031s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7662025-02-28T06:44:13.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 853.845898ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7672025-02-28T06:44:14.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0") failed: Property not found. retry in 1.135693254s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7682025-02-28T06:44:15.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_4f4c7990-c2dd-40da-b170-e650a4483069
7692025-02-28T06:44:15.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf
7702025-02-28T06:44:15.492ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_fcd8ae0d-2575-4673-8e36-6e281d9fbbb0
7712025-02-28T06:44:15.492ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-02-28T06:44:15.493ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732025-02-28T06:44:15.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9135837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58955 req_id = 2ea9e52c-2bce-41b6-9480-45f1be475f8e response_code = 204 uri = /omicron-zones
7742025-02-28T06:44:15.495ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-02-28T06:44:15.525ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 88.28266ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7762025-02-28T06:44:15.637ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-02-28T06:44:15.668ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 89.25583ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7782025-02-28T06:44:15.775ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7792025-02-28T06:44:15.823ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7802025-02-28T06:44:15.823ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7812025-02-28T06:44:15.853ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7822025-02-28T06:44:15.854ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7832025-02-28T06:44:15.854ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7842025-02-28T06:44:15.883ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7852025-02-28T06:44:15.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56629
7862025-02-28T06:44:15.884ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-02-28T06:44:15.884ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-02-28T06:44:15.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892025-02-28T06:44:15.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902025-02-28T06:44:15.903ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7912025-02-28T06:44:15.903ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7922025-02-28T06:44:15.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7932025-02-28T06:44:15.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
7942025-02-28T06:44:15.913ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
7952025-02-28T06:44:15.913ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7962025-02-28T06:44:15.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7972025-02-28T06:44:15.924ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7982025-02-28T06:44:15.955ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7992025-02-28T06:44:15.956ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
8002025-02-28T06:44:15.956ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
8012025-02-28T06:44:15.986ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 180, 14]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8022025-02-28T06:44:15.986ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
8032025-02-28T06:44:15.986ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8042025-02-28T06:44:15.986ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8052025-02-28T06:44:15.986ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8062025-02-28T06:44:15.987ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8072025-02-28T06:44:16.007ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a file = illumos-utils/src/zone.rs:325
8082025-02-28T06:44:16.026ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a file = illumos-utils/src/zone.rs:363
8092025-02-28T06:44:16.689ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8102025-02-28T06:44:16.689ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8112025-02-28T06:44:16.823ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 72.223042ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8122025-02-28T06:44:16.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 65.77079ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8132025-02-28T06:44:16.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 147.022767ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8142025-02-28T06:44:17.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 453.511127ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8152025-02-28T06:44:17.603ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 1.154601477s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8162025-02-28T06:44:18.262ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15629259735442405665 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8172025-02-28T06:44:18.266ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14917665648467173261 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8182025-02-28T06:44:18.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 532.130765ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8192025-02-28T06:44:18.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17265187205636014471 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8202025-02-28T06:44:18.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15778910903206655046 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8212025-02-28T06:44:19.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 1.428904434s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8222025-02-28T06:44:20.747ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a") failed: Property not found. retry in 1.244999946s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8232025-02-28T06:44:22.011ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a
8242025-02-28T06:44:22.011ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8252025-02-28T06:44:22.012ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8262025-02-28T06:44:22.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6128586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56629 req_id = a3a018f3-b7ab-4f5b-b3df-ed07084c3e14 response_code = 204 uri = /omicron-zones
8272025-02-28T06:44:22.014ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8282025-02-28T06:44:22.046ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-02-28T06:44:22.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63726
8302025-02-28T06:44:22.055ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8312025-02-28T06:44:22.056ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 9830 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63726 req_id = 2cb215c9-885b-45c7-b489-1b89649ed45e response_code = 500 uri = /timesync
8322025-02-28T06:44:22.058ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-02-28T06:44:22.179ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-02-28T06:44:22.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39325
8352025-02-28T06:44:24.713ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11838210798805696552 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8362025-02-28T06:44:24.793ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 952506547584287057 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8372025-02-28T06:44:25.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5052091996838476940 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8382025-02-28T06:44:26.187ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8392025-02-28T06:44:26.187ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39325 req_id = e7691ba7-a9d3-4c01-84e1-7b3f4c1be15d response_code = 500 uri = /timesync
8402025-02-28T06:44:26.189ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-02-28T06:44:26.309ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-02-28T06:44:26.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48887
8432025-02-28T06:44:26.318ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8442025-02-28T06:44:26.318ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 9078 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48887 req_id = 0badf2d8-a90a-4bc3-af70-58d3bf07cfc6 response_code = 500 uri = /timesync
8452025-02-28T06:44:26.321ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-02-28T06:44:26.547ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-02-28T06:44:26.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54635
8482025-02-28T06:44:26.556ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4ac7fce-4643-417a-8f7a-d2fe95db3d6a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8492025-02-28T06:44:26.556ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54635 req_id = ccf1865b-2bba-4373-ac51-42cf32bbbde0 response_code = 500 uri = /timesync
8502025-02-28T06:44:26.557ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-02-28T06:44:26.704ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-02-28T06:44:26.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64537
8532025-02-28T06:44:28.265ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15629259735442405665 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8542025-02-28T06:44:28.267ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14917665648467173261 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8552025-02-28T06:44:28.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2008424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64537 req_id = 72c00409-1d32-4379-8d11-c47084c0ccdc response_code = 200 uri = /timesync
8562025-02-28T06:44:28.714ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-02-28T06:44:28.714ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-02-28T06:44:28.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17265187205636014471 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8592025-02-28T06:44:28.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15778910903206655046 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
8602025-02-28T06:44:28.255ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-02-28T06:44:28.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64888
8622025-02-28T06:44:28.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 20207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64888 req_id = f44ddf40-523b-4259-b176-2d54cf0cc8f3 response_code = 200 uri = /timesync
8632025-02-28T06:44:28.279ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2750274066, ip_addr: 163.237.218.18, stratum: 2, ref_time: 1740725067.9441726, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8642025-02-28T06:44:28.279ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
8652025-02-28T06:44:28.308ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8662025-02-28T06:44:28.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35723
8672025-02-28T06:44:28.309ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8682025-02-28T06:44:28.309ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8692025-02-28T06:44:28.319ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8702025-02-28T06:44:28.319ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712025-02-28T06:44:28.328ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-02-28T06:44:28.329ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8732025-02-28T06:44:28.337ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-02-28T06:44:28.337ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8752025-02-28T06:44:28.346ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-02-28T06:44:28.346ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772025-02-28T06:44:28.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-02-28T06:44:28.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-02-28T06:44:28.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-02-28T06:44:28.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-02-28T06:44:28.374ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8822025-02-28T06:44:28.374ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8832025-02-28T06:44:28.382ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8842025-02-28T06:44:28.382ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
8852025-02-28T06:44:28.383ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
8862025-02-28T06:44:28.383ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
8872025-02-28T06:44:28.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8882025-02-28T06:44:28.415ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
8892025-02-28T06:44:28.415ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
8902025-02-28T06:44:28.415ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
8912025-02-28T06:44:28.415ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
8922025-02-28T06:44:28.415ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
8932025-02-28T06:44:28.415ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 106577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = c2d8fd79-2ae8-42bf-990c-09191c958cf5 response_code = 503 uri = /omicron-zones
8942025-02-28T06:44:28.415ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "c2d8fd79-2ae8-42bf-990c-09191c958cf5", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:28 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "c2d8fd79-2ae8-42bf-990c-09191c958cf5" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 82.481183ms sled_address = [fd00:1122:3344:101::1]:12345
8952025-02-28T06:44:28.499ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8962025-02-28T06:44:28.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8972025-02-28T06:44:28.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8982025-02-28T06:44:28.507ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8992025-02-28T06:44:28.507ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9002025-02-28T06:44:28.516ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9012025-02-28T06:44:28.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9022025-02-28T06:44:28.525ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9032025-02-28T06:44:28.525ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9042025-02-28T06:44:28.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9052025-02-28T06:44:28.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9062025-02-28T06:44:28.543ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9072025-02-28T06:44:28.543ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082025-02-28T06:44:28.552ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9092025-02-28T06:44:28.552ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9102025-02-28T06:44:28.561ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9112025-02-28T06:44:28.561ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9122025-02-28T06:44:28.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9132025-02-28T06:44:28.570ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
9142025-02-28T06:44:28.570ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
9152025-02-28T06:44:28.570ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9162025-02-28T06:44:28.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172025-02-28T06:44:29.021ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
9182025-02-28T06:44:29.021ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
9192025-02-28T06:44:29.021ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
9202025-02-28T06:44:29.021ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
9212025-02-28T06:44:29.021ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
9222025-02-28T06:44:29.021ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 103421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = bc47941e-2a2f-4cb2-94ca-510a24adb832 response_code = 503 uri = /omicron-zones
9232025-02-28T06:44:29.021ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "bc47941e-2a2f-4cb2-94ca-510a24adb832", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:28 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "bc47941e-2a2f-4cb2-94ca-510a24adb832" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 65.418182ms sled_address = [fd00:1122:3344:101::1]:12345
9242025-02-28T06:44:29.087ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9252025-02-28T06:44:29.088ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9262025-02-28T06:44:29.088ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9272025-02-28T06:44:29.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9282025-02-28T06:44:29.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9292025-02-28T06:44:29.108ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9302025-02-28T06:44:29.108ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9312025-02-28T06:44:29.117ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9322025-02-28T06:44:29.117ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9332025-02-28T06:44:29.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9342025-02-28T06:44:29.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9352025-02-28T06:44:29.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9362025-02-28T06:44:29.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9372025-02-28T06:44:29.144ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9382025-02-28T06:44:29.144ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9392025-02-28T06:44:29.154ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9402025-02-28T06:44:29.154ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9412025-02-28T06:44:29.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9422025-02-28T06:44:29.163ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
9432025-02-28T06:44:29.163ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
9442025-02-28T06:44:29.163ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9452025-02-28T06:44:29.163ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9462025-02-28T06:44:29.195ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
9472025-02-28T06:44:29.195ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
9482025-02-28T06:44:29.195ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
9492025-02-28T06:44:29.195ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
9502025-02-28T06:44:29.195ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
9512025-02-28T06:44:29.195ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 107641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = 10bb4efa-ee7b-4996-b1dc-261473ad11d7 response_code = 503 uri = /omicron-zones
9522025-02-28T06:44:29.195ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "10bb4efa-ee7b-4996-b1dc-261473ad11d7", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:28 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "10bb4efa-ee7b-4996-b1dc-261473ad11d7" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 92.611248ms sled_address = [fd00:1122:3344:101::1]:12345
9532025-02-28T06:44:29.290ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9542025-02-28T06:44:29.290ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9552025-02-28T06:44:29.290ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9562025-02-28T06:44:29.299ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9572025-02-28T06:44:29.299ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9582025-02-28T06:44:29.308ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9592025-02-28T06:44:29.308ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9602025-02-28T06:44:29.317ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9612025-02-28T06:44:29.317ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9622025-02-28T06:44:29.325ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9632025-02-28T06:44:29.325ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9642025-02-28T06:44:29.335ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9652025-02-28T06:44:29.335ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9662025-02-28T06:44:29.345ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9672025-02-28T06:44:29.345ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9682025-02-28T06:44:29.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9692025-02-28T06:44:29.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9702025-02-28T06:44:29.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9712025-02-28T06:44:29.365ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
9722025-02-28T06:44:29.365ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
9732025-02-28T06:44:29.365ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9742025-02-28T06:44:29.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9752025-02-28T06:44:29.399ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
9762025-02-28T06:44:29.399ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
9772025-02-28T06:44:29.399ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
9782025-02-28T06:44:29.399ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
9792025-02-28T06:44:29.399ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
9802025-02-28T06:44:29.399ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 109494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = 60e69995-750e-4c91-ae06-6026bce060cf response_code = 503 uri = /omicron-zones
9812025-02-28T06:44:29.399ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "60e69995-750e-4c91-ae06-6026bce060cf", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:28 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "60e69995-750e-4c91-ae06-6026bce060cf" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 136.042397ms sled_address = [fd00:1122:3344:101::1]:12345
9822025-02-28T06:44:29.537ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9832025-02-28T06:44:29.537ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9842025-02-28T06:44:29.537ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9852025-02-28T06:44:29.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9862025-02-28T06:44:29.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9872025-02-28T06:44:29.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9882025-02-28T06:44:29.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9892025-02-28T06:44:29.565ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9902025-02-28T06:44:29.565ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9912025-02-28T06:44:29.573ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9922025-02-28T06:44:29.573ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9932025-02-28T06:44:29.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9942025-02-28T06:44:29.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9952025-02-28T06:44:29.591ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9962025-02-28T06:44:29.591ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9972025-02-28T06:44:29.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9982025-02-28T06:44:29.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9992025-02-28T06:44:29.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10002025-02-28T06:44:29.609ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
10012025-02-28T06:44:29.609ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
10022025-02-28T06:44:29.609ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10032025-02-28T06:44:29.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10042025-02-28T06:44:29.641ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
10052025-02-28T06:44:29.641ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10062025-02-28T06:44:29.641ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10072025-02-28T06:44:29.641ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
10082025-02-28T06:44:29.641ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
10092025-02-28T06:44:29.641ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 104166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = 640d1773-55f6-4d83-bab0-b628def6080d response_code = 503 uri = /omicron-zones
10102025-02-28T06:44:29.641ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "640d1773-55f6-4d83-bab0-b628def6080d", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:28 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "640d1773-55f6-4d83-bab0-b628def6080d" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 171.463898ms sled_address = [fd00:1122:3344:101::1]:12345
10112025-02-28T06:44:29.814ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10122025-02-28T06:44:29.814ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10132025-02-28T06:44:29.814ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10142025-02-28T06:44:29.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10152025-02-28T06:44:29.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10162025-02-28T06:44:29.833ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10172025-02-28T06:44:29.833ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10182025-02-28T06:44:29.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10192025-02-28T06:44:29.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202025-02-28T06:44:29.852ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10212025-02-28T06:44:29.852ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222025-02-28T06:44:29.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10232025-02-28T06:44:29.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10242025-02-28T06:44:29.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10252025-02-28T06:44:29.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10262025-02-28T06:44:29.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10272025-02-28T06:44:29.880ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10282025-02-28T06:44:29.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10292025-02-28T06:44:29.889ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
10302025-02-28T06:44:29.890ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
10312025-02-28T06:44:29.890ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10322025-02-28T06:44:29.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10332025-02-28T06:44:29.921ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10342025-02-28T06:44:29.921ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
10352025-02-28T06:44:29.921ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10362025-02-28T06:44:29.921ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
10372025-02-28T06:44:29.921ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3419 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
10382025-02-28T06:44:29.921ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Service Unavailable error_message_internal = Time not yet synchronized file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 107632 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = 6a69acc6-5e09-4590-888c-470884c9718d response_code = 503 uri = /omicron-zones
10392025-02-28T06:44:29.922ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "6a69acc6-5e09-4590-888c-470884c9718d", "content-length": "133", "date": "Fri, 28 Feb 2025 06:44:29 GMT"}; value: Error { error_code: Some("ServiceNotAvailable"), message: "Service Unavailable", request_id: "6a69acc6-5e09-4590-888c-470884c9718d" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 286.095466ms sled_address = [fd00:1122:3344:101::1]:12345
10402025-02-28T06:44:30.210ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10412025-02-28T06:44:30.210ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-02-28T06:44:30.210ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10432025-02-28T06:44:30.219ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-02-28T06:44:30.219ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10452025-02-28T06:44:30.229ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-02-28T06:44:30.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10472025-02-28T06:44:30.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-02-28T06:44:30.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-02-28T06:44:30.246ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10502025-02-28T06:44:30.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512025-02-28T06:44:30.256ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10522025-02-28T06:44:30.256ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10532025-02-28T06:44:30.267ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-02-28T06:44:30.267ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10552025-02-28T06:44:30.277ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-02-28T06:44:30.277ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10572025-02-28T06:44:30.286ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10582025-02-28T06:44:30.286ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
10592025-02-28T06:44:30.286ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
10602025-02-28T06:44:30.286ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10612025-02-28T06:44:30.286ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10622025-02-28T06:44:30.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10632025-02-28T06:44:30.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10642025-02-28T06:44:30.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10652025-02-28T06:44:30.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10662025-02-28T06:44:30.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10672025-02-28T06:44:30.461ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222 file = illumos-utils/src/zone.rs:325
10682025-02-28T06:44:30.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0 file = illumos-utils/src/zone.rs:325
10692025-02-28T06:44:30.470ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c file = illumos-utils/src/zone.rs:325
10702025-02-28T06:44:30.474ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 file = illumos-utils/src/zone.rs:325
10712025-02-28T06:44:30.478ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b file = illumos-utils/src/zone.rs:325
10722025-02-28T06:44:30.483ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222 file = illumos-utils/src/zone.rs:363
10732025-02-28T06:44:30.488ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0 file = illumos-utils/src/zone.rs:363
10742025-02-28T06:44:30.492ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c file = illumos-utils/src/zone.rs:363
10752025-02-28T06:44:30.497ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 file = illumos-utils/src/zone.rs:363
10762025-02-28T06:44:30.502ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b file = illumos-utils/src/zone.rs:363
10772025-02-28T06:44:33.709ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e5a7b872-656b-46a5-862b-1d6ae16ee6e0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782025-02-28T06:44:33.709ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10792025-02-28T06:44:33.715ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802025-02-28T06:44:33.715ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='306dfaae-c4fc-4f95-9576-6a4349e128e1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812025-02-28T06:44:33.715ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='37ce8bb9-57cb-4dd4-8aa1-52445f96a222'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10822025-02-28T06:44:33.715ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
10832025-02-28T06:44:33.720ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10842025-02-28T06:44:33.724ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
10852025-02-28T06:44:33.777ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e956a8d8-0cb7-4c1d-ac6a-88c027a4347b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10862025-02-28T06:44:33.777ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
10872025-02-28T06:44:33.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 30.952049ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10882025-02-28T06:44:33.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 39.272686ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10892025-02-28T06:44:33.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 64.231489ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
10902025-02-28T06:44:33.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 50.070856ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
10912025-02-28T06:44:33.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 113.181114ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10922025-02-28T06:44:33.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 101.306086ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10932025-02-28T06:44:33.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 46.776532ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
10942025-02-28T06:44:34.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 96.810936ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
10952025-02-28T06:44:34.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 256.752389ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
10962025-02-28T06:44:34.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 111.093745ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
10972025-02-28T06:44:35.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 107.84088ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
10982025-02-28T06:44:35.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 56.196305ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
10992025-02-28T06:44:35.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 130.925341ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11002025-02-28T06:44:35.166ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 351.039506ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11012025-02-28T06:44:35.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 248.624942ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11022025-02-28T06:44:35.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 369.719184ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11032025-02-28T06:44:35.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 235.488923ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11042025-02-28T06:44:35.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 408.108919ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11052025-02-28T06:44:35.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 521.695905ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11062025-02-28T06:44:35.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 382.790229ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11072025-02-28T06:44:35.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 785.1415ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11082025-02-28T06:44:35.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 957.917001ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11092025-02-28T06:44:35.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.056969657s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11102025-02-28T06:44:35.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 704.944258ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11112025-02-28T06:44:35.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 1.015014073s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11122025-02-28T06:44:36.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.305009824s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11132025-02-28T06:44:36.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 650.563337ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11142025-02-28T06:44:36.590ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 920.888483ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11152025-02-28T06:44:36.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 916.374813ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11162025-02-28T06:44:37.013ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 1.344232964s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11172025-02-28T06:44:37.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.258640676s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11182025-02-28T06:44:37.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 1.119821037s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11192025-02-28T06:44:37.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 893.720196ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11202025-02-28T06:44:37.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.466497s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11212025-02-28T06:44:37.981ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61404
11222025-02-28T06:44:37.981ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61404 req_id = f30faba4-fd93-4945-89ac-f804074c70ec response_code = 200 uri = /baseboard
11232025-02-28T06:44:38.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 875.22549ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11242025-02-28T06:44:38.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.283003237s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11252025-02-28T06:44:38.574ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.417839883s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11262025-02-28T06:44:38.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 1.042757269s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11272025-02-28T06:44:38.858ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 334.814546ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
11282025-02-28T06:44:39.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 796.585084ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11292025-02-28T06:44:39.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 674.192246ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11302025-02-28T06:44:39.711ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 832.324324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11312025-02-28T06:44:39.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.234324048s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11322025-02-28T06:44:39.945ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 830.13498ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11332025-02-28T06:44:40.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.259839261s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11342025-02-28T06:44:40.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.309941465s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11352025-02-28T06:44:40.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 1.073537576s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11362025-02-28T06:44:40.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 1.493384001s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11372025-02-28T06:44:41.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 988.754956ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11382025-02-28T06:44:41.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 772.02789ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11392025-02-28T06:44:41.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.460466052s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11402025-02-28T06:44:41.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b") failed: Property not found. retry in 1.261557627s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11412025-02-28T06:44:42.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.19326305s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11422025-02-28T06:44:42.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.168169892s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11432025-02-28T06:44:42.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c") failed: Property not found. retry in 1.350189492s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11442025-02-28T06:44:42.808ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 822.962843ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11452025-02-28T06:44:43.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.437201149s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11462025-02-28T06:44:43.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 778.750073ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11472025-02-28T06:44:43.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.369327932s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11482025-02-28T06:44:44.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.26797602s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11492025-02-28T06:44:44.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.469688728s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11502025-02-28T06:44:45.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.254570607s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11512025-02-28T06:44:45.425ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 948.513511ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11522025-02-28T06:44:46.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 692.988435ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11532025-02-28T06:44:46.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.275515354s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11542025-02-28T06:44:46.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.105685427s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11552025-02-28T06:44:46.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 639.151405ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11562025-02-28T06:44:47.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 553.256508ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11572025-02-28T06:44:47.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.295116901s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11582025-02-28T06:44:47.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.445914375s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11592025-02-28T06:44:48.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 697.452451ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11602025-02-28T06:44:48.798ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 537.077764ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11612025-02-28T06:44:48.860ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 808.773495ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11622025-02-28T06:44:49.126ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 815.155446ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11632025-02-28T06:44:49.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.169022832s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11642025-02-28T06:44:49.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 906.825245ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11652025-02-28T06:44:49.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 1.284032761s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11662025-02-28T06:44:50.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.425136679s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11672025-02-28T06:44:50.592ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.134117128s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11682025-02-28T06:44:51.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 799.4019ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11692025-02-28T06:44:51.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222") failed: Property not found. retry in 1.260141163s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11702025-02-28T06:44:51.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0") failed: Property not found. retry in 1.063203574s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11712025-02-28T06:44:52.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1") failed: Property not found. retry in 991.206316ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11722025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_37ce8bb9-57cb-4dd4-8aa1-52445f96a222
11732025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_e5a7b872-656b-46a5-862b-1d6ae16ee6e0
11742025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c
11752025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1
11762025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_e956a8d8-0cb7-4c1d-ac6a-88c027a4347b
11772025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11782025-02-28T06:44:53.063ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11792025-02-28T06:44:53.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 22815970 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35723 req_id = 1eca9fcb-d5fb-46c9-a6f5-f7556515065c response_code = 204 uri = /omicron-zones
11802025-02-28T06:44:53.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48589
11812025-02-28T06:44:53.127ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48589 req_id = 28b149a6-85bb-4592-bc3a-e0acffd8ff9a response_code = 500 uri = /cockroachdb
11822025-02-28T06:44:53.127ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28b149a6-85bb-4592-bc3a-e0acffd8ff9a", "content-length": "124", "date": "Fri, 28 Feb 2025 06:44:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28b149a6-85bb-4592-bc3a-e0acffd8ff9a" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 94.74898ms
11832025-02-28T06:44:53.249ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48589 req_id = e841da05-ec40-4426-83b7-de56f81f4340 response_code = 500 uri = /cockroachdb
11842025-02-28T06:44:53.249ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e841da05-ec40-4426-83b7-de56f81f4340", "content-length": "124", "date": "Fri, 28 Feb 2025 06:44:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e841da05-ec40-4426-83b7-de56f81f4340" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 116.605241ms
11852025-02-28T06:44:53.393ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48589 req_id = bd9bf1a5-c7e1-49a7-99f4-07ce44b9aeeb response_code = 500 uri = /cockroachdb
11862025-02-28T06:44:53.393ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bd9bf1a5-c7e1-49a7-99f4-07ce44b9aeeb", "content-length": "124", "date": "Fri, 28 Feb 2025 06:44:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bd9bf1a5-c7e1-49a7-99f4-07ce44b9aeeb" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 112.851149ms
11872025-02-28T06:44:53.534ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_306dfaae-c4fc-4f95-9576-6a4349e128e1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48589 req_id = 9df7e1f0-56a6-462a-b9a3-6a6b0c74d76e response_code = 500 uri = /cockroachdb
11882025-02-28T06:44:53.535ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9df7e1f0-56a6-462a-b9a3-6a6b0c74d76e", "content-length": "124", "date": "Fri, 28 Feb 2025 06:44:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9df7e1f0-56a6-462a-b9a3-6a6b0c74d76e" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 142.248192ms
11892025-02-28T06:44:53.708ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3852
11902025-02-28T06:45:03.209ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
11912025-02-28T06:45:20.393ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
11922025-02-28T06:45:20.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26717341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:48589 req_id = 62a13c08-5cbf-418c-b65a-46679b57ffac response_code = 204 uri = /cockroachdb
11932025-02-28T06:45:20.400ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50305
11942025-02-28T06:45:20.403ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 817 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50305 req_id = 9a66065a-fc13-4394-9cbc-d9a669984cfe response_code = 200 uri = /baseboard
11952025-02-28T06:45:20.420ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 685.486325ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
11962025-02-28T06:45:20.462ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7efe5fd6-f5d8-4d88-9eb1-e557a2c38faf (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: fcd8ae0d-2575-4673-8e36-6e281d9fbbb0 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4f4c7990-c2dd-40da-b170-e650a4483069 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: c7c7704a-fd6d-4c85-8000-f919f06f6602, kind: Service { id: a4ac7fce-4643-417a-8f7a-d2fe95db3d6a }, name: Name("ntp-a4ac7fce-4643-417a-8f7a-d2fe95db3d6a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 14])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: e5a7b872-656b-46a5-862b-1d6ae16ee6e0 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 37ce8bb9-57cb-4dd4-8aa1-52445f96a222 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 306dfaae-c4fc-4f95-9576-6a4349e128e1 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8cd9abc3-7a61-44f3-9aae-450a7fb8dc3c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e956a8d8-0cb7-4c1d-ac6a-88c027a4347b (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 60dda83b-119e-4091-89bb-47146b9a4e21 (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 6d7f93d5-671d-4f52-9b87-78d19291764d (service), filesystem_pool: Some(ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 (service), filesystem_pool: Some(ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: e72f5a53-a61c-40ae-9405-7898df860fb2 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: 4c6b65a6-1a8a-4846-8854-afbb68a1c5be (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 44749f91-354a-42ab-b90f-ecccbaaa9350 (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 13017202-14c7-4bde-b922-741839412f92 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: b6304130-6f89-47cb-94bb-f8a571d2bb98 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7d6eb2e7-b425-45d2-86bd-6e02b7d4585a (service), filesystem_pool: Some(ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 17130402-2073-40d7-b72b-01697b9cffc7 (service), filesystem_pool: Some(ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 74a8d1f8-f20f-4b97-a9a0-236ed15e1a34 (service), filesystem_pool: Some(ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3 (service), filesystem_pool: Some(ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f06cf8ec-9e46-4599-a89c-a080b42d9c26 (service), filesystem_pool: Some(ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 253d80bc-2577-49b2-9a32-b835e93520b5 (service), filesystem_pool: Some(ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 118d1ef2-29f5-4549-af1e-9101e16957c8 (service), filesystem_pool: Some(ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3fd7a640-e26a-4e71-96e9-c971fe868468 (service), filesystem_pool: Some(ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 31d31e90-3f54-42a5-9c6a-3a39893947e4 (service), filesystem_pool: Some(ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11972025-02-28T06:45:20.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49447
11982025-02-28T06:45:20.466ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-02-28T06:45:20.466ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12002025-02-28T06:45:20.480ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-02-28T06:45:20.480ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: InternalDns }, responder: ... }
12022025-02-28T06:45:20.490ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-02-28T06:45:20.490ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: InternalDns }, responder: ... }
12042025-02-28T06:45:20.500ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-02-28T06:45:20.500ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12062025-02-28T06:45:20.509ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-02-28T06:45:20.509ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Cockroach }, responder: ... }
12082025-02-28T06:45:20.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-02-28T06:45:20.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102025-02-28T06:45:20.528ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12112025-02-28T06:45:20.528ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
12122025-02-28T06:45:20.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12132025-02-28T06:45:20.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12142025-02-28T06:45:20.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12152025-02-28T06:45:20.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12162025-02-28T06:45:20.558ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-02-28T06:45:20.558ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12182025-02-28T06:45:20.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-02-28T06:45:20.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12202025-02-28T06:45:20.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-02-28T06:45:20.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12222025-02-28T06:45:20.589ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-02-28T06:45:20.589ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, kind: Crucible }, responder: ... }
12242025-02-28T06:45:20.599ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-02-28T06:45:20.599ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, kind: Crucible }, responder: ... }
12262025-02-28T06:45:20.610ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12272025-02-28T06:45:20.610ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, kind: Crucible }, responder: ... }
12282025-02-28T06:45:20.622ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12292025-02-28T06:45:20.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, kind: Crucible }, responder: ... }
12302025-02-28T06:45:20.633ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12312025-02-28T06:45:20.633ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, kind: Crucible }, responder: ... }
12322025-02-28T06:45:20.643ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12332025-02-28T06:45:20.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, kind: Crucible }, responder: ... }
12342025-02-28T06:45:20.654ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12352025-02-28T06:45:20.654ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, kind: Crucible }, responder: ... }
12362025-02-28T06:45:20.665ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12372025-02-28T06:45:20.665ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, kind: Crucible }, responder: ... }
12382025-02-28T06:45:20.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12392025-02-28T06:45:20.677ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
12402025-02-28T06:45:20.678ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
12412025-02-28T06:45:20.678ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
12422025-02-28T06:45:20.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12432025-02-28T06:45:20.812ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442025-02-28T06:45:20.812ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-02-28T06:45:20.862ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12462025-02-28T06:45:20.862ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12472025-02-28T06:45:20.862ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-02-28T06:45:20.862ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492025-02-28T06:45:20.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12502025-02-28T06:45:20.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12512025-02-28T06:45:20.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12522025-02-28T06:45:20.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12532025-02-28T06:45:21.048ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12542025-02-28T06:45:21.117ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12552025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12562025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12582025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12592025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12602025-02-28T06:45:21.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12612025-02-28T06:45:21.119ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12622025-02-28T06:45:21.119ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7 file = illumos-utils/src/zone.rs:325
12632025-02-28T06:45:21.126ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34 file = illumos-utils/src/zone.rs:325
12642025-02-28T06:45:21.132ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be file = illumos-utils/src/zone.rs:325
12652025-02-28T06:45:21.138ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98 file = illumos-utils/src/zone.rs:325
12662025-02-28T06:45:21.144ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5 file = illumos-utils/src/zone.rs:325
12672025-02-28T06:45:21.150ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3 file = illumos-utils/src/zone.rs:325
12682025-02-28T06:45:21.156ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26 file = illumos-utils/src/zone.rs:325
12692025-02-28T06:45:21.162ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350 file = illumos-utils/src/zone.rs:325
12702025-02-28T06:45:21.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7 file = illumos-utils/src/zone.rs:363
12712025-02-28T06:45:21.294ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34 file = illumos-utils/src/zone.rs:363
12722025-02-28T06:45:21.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be file = illumos-utils/src/zone.rs:363
12732025-02-28T06:45:21.303ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98 file = illumos-utils/src/zone.rs:363
12742025-02-28T06:45:21.308ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5 file = illumos-utils/src/zone.rs:363
12752025-02-28T06:45:21.313ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3 file = illumos-utils/src/zone.rs:363
12762025-02-28T06:45:21.318ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26 file = illumos-utils/src/zone.rs:363
12772025-02-28T06:45:21.323ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350 file = illumos-utils/src/zone.rs:363
12782025-02-28T06:45:21.328ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92 file = illumos-utils/src/zone.rs:325
12792025-02-28T06:45:21.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a file = illumos-utils/src/zone.rs:325
12802025-02-28T06:45:21.339ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8 file = illumos-utils/src/zone.rs:325
12812025-02-28T06:45:21.346ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468 file = illumos-utils/src/zone.rs:325
12822025-02-28T06:45:21.353ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4 file = illumos-utils/src/zone.rs:325
12832025-02-28T06:45:21.359ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2 file = illumos-utils/src/zone.rs:325
12842025-02-28T06:45:21.428ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12852025-02-28T06:45:21.428ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92 file = illumos-utils/src/zone.rs:363
12862025-02-28T06:45:21.439ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a file = illumos-utils/src/zone.rs:363
12872025-02-28T06:45:21.449ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8 file = illumos-utils/src/zone.rs:363
12882025-02-28T06:45:21.464ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468 file = illumos-utils/src/zone.rs:363
12892025-02-28T06:45:21.477ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4 file = illumos-utils/src/zone.rs:363
12902025-02-28T06:45:21.487ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2 file = illumos-utils/src/zone.rs:363
12912025-02-28T06:45:21.558ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12922025-02-28T06:45:21.620ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12932025-02-28T06:45:21.682ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12942025-02-28T06:45:21.825ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12952025-02-28T06:45:21.827ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962025-02-28T06:45:21.828ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972025-02-28T06:45:21.889ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 146, 203]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12982025-02-28T06:45:21.889ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
12992025-02-28T06:45:21.892ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13002025-02-28T06:45:21.892ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13012025-02-28T06:45:21.948ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 163, 87]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13022025-02-28T06:45:21.948ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13032025-02-28T06:45:21.950ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13042025-02-28T06:45:21.950ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13052025-02-28T06:45:22.006ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 129, 218]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13062025-02-28T06:45:22.006ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13072025-02-28T06:45:22.008ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13082025-02-28T06:45:22.008ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13092025-02-28T06:45:22.064ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 175, 181]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13102025-02-28T06:45:22.064ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
13112025-02-28T06:45:22.066ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13122025-02-28T06:45:22.066ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13132025-02-28T06:45:22.142ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 222, 55]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13142025-02-28T06:45:22.142ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13152025-02-28T06:45:22.142ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13162025-02-28T06:45:22.142ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13172025-02-28T06:45:22.145ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13182025-02-28T06:45:22.145ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13192025-02-28T06:45:22.154ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13202025-02-28T06:45:22.154ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13212025-02-28T06:45:22.155ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13222025-02-28T06:45:22.155ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13232025-02-28T06:45:22.155ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13242025-02-28T06:45:22.157ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13252025-02-28T06:45:22.157ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13262025-02-28T06:45:22.157ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13272025-02-28T06:45:22.157ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13282025-02-28T06:45:22.159ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13292025-02-28T06:45:22.162ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13302025-02-28T06:45:22.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13312025-02-28T06:45:22.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13322025-02-28T06:45:22.164ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13332025-02-28T06:45:22.210ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13342025-02-28T06:45:22.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13352025-02-28T06:45:22.415ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21 file = illumos-utils/src/zone.rs:325
13362025-02-28T06:45:22.471ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d file = illumos-utils/src/zone.rs:325
13372025-02-28T06:45:22.482ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547 file = illumos-utils/src/zone.rs:325
13382025-02-28T06:45:22.492ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9 file = illumos-utils/src/zone.rs:325
13392025-02-28T06:45:22.504ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21 file = illumos-utils/src/zone.rs:363
13402025-02-28T06:45:22.516ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c file = illumos-utils/src/zone.rs:325
13412025-02-28T06:45:22.529ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d file = illumos-utils/src/zone.rs:363
13422025-02-28T06:45:22.540ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547 file = illumos-utils/src/zone.rs:363
13432025-02-28T06:45:22.555ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9 file = illumos-utils/src/zone.rs:363
13442025-02-28T06:45:22.566ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c file = illumos-utils/src/zone.rs:363
13452025-02-28T06:45:35.463ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462025-02-28T06:45:35.481ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472025-02-28T06:45:35.499ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
13482025-02-28T06:45:35.563ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
13492025-02-28T06:45:36.376ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7091494f-09b0-4f83-b771-087a1356d724'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502025-02-28T06:45:36.377ZINFOSledAgent (ServiceManager): Booting oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
13512025-02-28T06:45:36.402ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 719.013355ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
13522025-02-28T06:45:36.429ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_574faf87-fd2d-44c5-bef4-135771b1853a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='02a0779b-21f0-46d5-a9a9-2a7168060590'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532025-02-28T06:45:36.430ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5d442394-c6cd-431a-a36c-306a75e748bc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542025-02-28T06:45:36.433ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_36abc0e0-9d49-4738-89cf-f6343849532d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f14e1a37-a898-47bb-874c-7b7fbb6a81f0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552025-02-28T06:45:36.433ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='492a8087-2511-4790-b00f-7fa7d4aa8627'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562025-02-28T06:45:36.434ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c91d9d4f-fc8f-419b-b8b9-43d321ff4725'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572025-02-28T06:45:36.434ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b620ef43-dc0d-441b-9701-828101dd4d57'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582025-02-28T06:45:36.434ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
13592025-02-28T06:45:36.442ZINFOSledAgent (ServiceManager): Booting oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
13602025-02-28T06:45:36.449ZINFOSledAgent (ServiceManager): Booting oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
13612025-02-28T06:45:36.455ZINFOSledAgent (ServiceManager): Booting oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
13622025-02-28T06:45:36.470ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
13632025-02-28T06:45:36.476ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
13642025-02-28T06:45:37.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 61.464129ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
13652025-02-28T06:45:37.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 43.741019ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
13662025-02-28T06:45:37.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 34.000543ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
13672025-02-28T06:45:37.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 29.494993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
13682025-02-28T06:45:37.631ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 36.023299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
13692025-02-28T06:45:37.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 32.67916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
13702025-02-28T06:45:37.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 54.761152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
13712025-02-28T06:45:37.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 38.541221ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
13722025-02-28T06:45:37.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 41.990968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
13732025-02-28T06:45:37.683ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 85.86072ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
13742025-02-28T06:45:37.695ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 105.76402ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
13752025-02-28T06:45:37.705ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 100.737968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
13762025-02-28T06:45:37.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 146.380473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
13772025-02-28T06:45:37.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 124.274216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
13782025-02-28T06:45:37.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 135.127498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
13792025-02-28T06:45:37.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 74.217506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
13802025-02-28T06:45:37.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 146.442479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
13812025-02-28T06:45:37.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 78.118557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
13822025-02-28T06:45:37.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 156.302272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
13832025-02-28T06:45:37.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 105.963073ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
13842025-02-28T06:45:37.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 264.085089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
13852025-02-28T06:45:37.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 170.535837ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
13862025-02-28T06:45:37.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 128.547288ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
13872025-02-28T06:45:37.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 107.503061ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
13882025-02-28T06:45:37.934ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 265.346406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
13892025-02-28T06:45:37.951ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 215.795849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
13902025-02-28T06:45:37.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 241.060691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
13912025-02-28T06:45:37.975ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 359.214716ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
13922025-02-28T06:45:37.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 532.169648ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
13932025-02-28T06:45:38.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 415.202684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
13942025-02-28T06:45:38.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 265.865772ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
13952025-02-28T06:45:38.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 481.47347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
13962025-02-28T06:45:38.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 213.313454ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
13972025-02-28T06:45:38.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 212.715189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
13982025-02-28T06:45:38.213ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 310.309865ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
13992025-02-28T06:45:38.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 250.42599ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
14002025-02-28T06:45:38.243ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d2784454-b55f-4188-9b0e-6bdd268aaa07'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012025-02-28T06:45:38.243ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14022025-02-28T06:45:38.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.146931784s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
14032025-02-28T06:45:38.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 760.73777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
14042025-02-28T06:45:38.393ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 676.321559ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
14052025-02-28T06:45:38.410ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 685.35253ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
14062025-02-28T06:45:38.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.060353686s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
14072025-02-28T06:45:38.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 44.704089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14082025-02-28T06:45:38.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 998.746602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
14092025-02-28T06:45:38.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.062318413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
14102025-02-28T06:45:38.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 53.594335ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14112025-02-28T06:45:38.548ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 555.596363ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
14122025-02-28T06:45:38.580ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 962.20615ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
14132025-02-28T06:45:38.603ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 202.38124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14142025-02-28T06:45:38.820ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 461.255346ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14152025-02-28T06:45:38.891ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14162025-02-28T06:45:38.898ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14172025-02-28T06:45:39.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 532.67302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
14182025-02-28T06:45:39.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 959.541363ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
14192025-02-28T06:45:39.122ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 35.703948ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14202025-02-28T06:45:39.134ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.02837264s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
14212025-02-28T06:45:39.149ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.287541277s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
14222025-02-28T06:45:39.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 52.809183ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14232025-02-28T06:45:39.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 259.843205ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14242025-02-28T06:45:39.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.048119877s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14252025-02-28T06:45:39.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 646.245835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
14262025-02-28T06:45:39.594ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 433.757219ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14272025-02-28T06:45:39.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.248024624s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
14282025-02-28T06:45:39.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.170781448s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
14292025-02-28T06:45:39.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.144983246s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
14302025-02-28T06:45:39.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 740.703965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
14312025-02-28T06:45:39.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 937.358767ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
14322025-02-28T06:45:40.018ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3430e022-7133-4293-ac77-634fd73d7c3b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e61d5e38-399c-42aa-ac67-5c7f63d2bda8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14332025-02-28T06:45:40.018ZINFOSledAgent (ServiceManager): Booting oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14342025-02-28T06:45:40.044ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.006533531s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14352025-02-28T06:45:40.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 916.227743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
14362025-02-28T06:45:40.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 735.293386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
14372025-02-28T06:45:40.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.268190685s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
14382025-02-28T06:45:40.254ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14392025-02-28T06:45:40.254ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14402025-02-28T06:45:40.262ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14412025-02-28T06:45:40.263ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14422025-02-28T06:45:40.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 52.587437ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14432025-02-28T06:45:40.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 70.663979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14442025-02-28T06:45:40.376ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.330995286s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14452025-02-28T06:45:40.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 1.384388823s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
14462025-02-28T06:45:40.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 232.085723ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14472025-02-28T06:45:40.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 941.987137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
14482025-02-28T06:45:40.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 74.774723ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14492025-02-28T06:45:40.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 58.890617ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14502025-02-28T06:45:40.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.345298716s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
14512025-02-28T06:45:40.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 80.458367ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14522025-02-28T06:45:40.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 62.889824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14532025-02-28T06:45:40.716ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 542.439997ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14542025-02-28T06:45:40.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 115.204902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14552025-02-28T06:45:40.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 125.495912ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14562025-02-28T06:45:40.795ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14572025-02-28T06:45:40.795ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14582025-02-28T06:45:40.796ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14592025-02-28T06:45:40.796ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
14602025-02-28T06:45:40.804ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
14612025-02-28T06:45:40.811ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
14622025-02-28T06:45:40.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 630.06122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
14632025-02-28T06:45:40.846ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 665.070761ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
14642025-02-28T06:45:40.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 475.696328ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14652025-02-28T06:45:40.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.156638604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
14662025-02-28T06:45:40.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 276.125857ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14672025-02-28T06:45:40.929ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.243662926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
14682025-02-28T06:45:41.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 917.42631ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
14692025-02-28T06:45:41.030ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 46.192019ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
14702025-02-28T06:45:41.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 43.600773ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
14712025-02-28T06:45:41.057ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 42.17469ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
14722025-02-28T06:45:41.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.006130509s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
14732025-02-28T06:45:41.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 51.444699ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
14742025-02-28T06:45:41.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 53.450873ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
14752025-02-28T06:45:41.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 55.324479ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
14762025-02-28T06:45:41.199ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='e72f5a53-a61c-40ae-9405-7898df860fb2'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14772025-02-28T06:45:41.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 262.642618ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
14782025-02-28T06:45:41.290ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 257.863326ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
14792025-02-28T06:45:41.290ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
14802025-02-28T06:45:41.310ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 401.569122ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14812025-02-28T06:45:41.319ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 249.17198ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
14822025-02-28T06:45:41.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 578.743933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
14832025-02-28T06:45:41.362ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 513.074795ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14842025-02-28T06:45:41.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.072685817s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
14852025-02-28T06:45:41.475ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 729.782059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
14862025-02-28T06:45:41.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.199124858s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
14872025-02-28T06:45:41.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.031764057s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
14882025-02-28T06:45:41.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 389.038482ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
14892025-02-28T06:45:41.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 375.3519ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
14902025-02-28T06:45:41.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 27.93509ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
14912025-02-28T06:45:41.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 547.24852ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
14922025-02-28T06:45:41.609ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 95.876992ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
14932025-02-28T06:45:41.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 123.958377ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
14942025-02-28T06:45:41.729ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 517.24806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
14952025-02-28T06:45:41.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 897.959483ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
14962025-02-28T06:45:41.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 557.825306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
14972025-02-28T06:45:41.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 422.84653ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
14982025-02-28T06:45:41.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 689.152054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
14992025-02-28T06:45:41.921ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.171100609s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15002025-02-28T06:45:41.945ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.130216001s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
15012025-02-28T06:45:41.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.069715616s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
15022025-02-28T06:45:41.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 682.912787ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15032025-02-28T06:45:42.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 506.959218ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15042025-02-28T06:45:42.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.126144923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15052025-02-28T06:45:42.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.151581583s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
15062025-02-28T06:45:42.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 659.494831ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15072025-02-28T06:45:42.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 837.179921ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
15082025-02-28T06:45:42.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 908.627254ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
15092025-02-28T06:45:42.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 804.996789ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15102025-02-28T06:45:42.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 522.539528ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15112025-02-28T06:45:42.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 715.518268ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15122025-02-28T06:45:42.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.037987677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15132025-02-28T06:45:42.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 706.441766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
15142025-02-28T06:45:42.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.345955178s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
15152025-02-28T06:45:42.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 756.861101ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
15162025-02-28T06:45:42.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 841.940765ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
15172025-02-28T06:45:42.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 1.201500276s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15182025-02-28T06:45:42.712ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.450637519s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
15192025-02-28T06:45:42.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 864.603367ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15202025-02-28T06:45:42.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 582.267684ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15212025-02-28T06:45:43.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 704.925696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
15222025-02-28T06:45:43.038ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.324360917s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
15232025-02-28T06:45:43.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.108668827s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15242025-02-28T06:45:43.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 876.065786ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
15252025-02-28T06:45:43.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 874.709053ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15262025-02-28T06:45:43.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.466100758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
15272025-02-28T06:45:43.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 708.446048ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15282025-02-28T06:45:43.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 781.069249ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15292025-02-28T06:45:43.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.193886544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
15302025-02-28T06:45:43.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.162273655s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
15312025-02-28T06:45:43.356ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.490013687s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
15322025-02-28T06:45:43.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 719.070077ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15332025-02-28T06:45:43.502ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 970.621043ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
15342025-02-28T06:45:43.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.060776124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15352025-02-28T06:45:43.685ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 899.937948ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15362025-02-28T06:45:43.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.47410869s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
15372025-02-28T06:45:43.859ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 773.001591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15382025-02-28T06:45:43.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 692.474463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15392025-02-28T06:45:43.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 790.145953ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
15402025-02-28T06:45:43.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.215566898s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
15412025-02-28T06:45:43.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 691.239281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15422025-02-28T06:45:43.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 596.159601ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15432025-02-28T06:45:44.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.324153488s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15442025-02-28T06:45:44.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 596.935843ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
15452025-02-28T06:45:44.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.04980429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15462025-02-28T06:45:44.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.033568431s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
15472025-02-28T06:45:44.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 786.405186ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
15482025-02-28T06:45:44.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.269195381s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
15492025-02-28T06:45:44.482ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 942.741025ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
15502025-02-28T06:45:44.576ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 605.170426ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15512025-02-28T06:45:44.597ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.351382389s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15522025-02-28T06:45:44.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.121251183s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15532025-02-28T06:45:44.621ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 793.904174ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
15542025-02-28T06:45:44.650ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.065951182s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15552025-02-28T06:45:44.660ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 1.357725726s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15562025-02-28T06:45:44.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.011971039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15572025-02-28T06:45:44.720ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 862.408322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
15582025-02-28T06:45:44.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.177714997s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
15592025-02-28T06:45:44.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.040124757s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
15602025-02-28T06:45:45.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 545.80914ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15612025-02-28T06:45:45.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 628.546755ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
15622025-02-28T06:45:45.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 984.72844ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
15632025-02-28T06:45:45.229ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.489719849s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
15642025-02-28T06:45:45.249ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 690.423011ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15652025-02-28T06:45:45.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 839.640568ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
15662025-02-28T06:45:45.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.130871822s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
15672025-02-28T06:45:45.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.112358204s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
15682025-02-28T06:45:45.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 748.382832ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15692025-02-28T06:45:45.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.442025028s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
15702025-02-28T06:45:45.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 732.898959ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15712025-02-28T06:45:45.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 991.013633ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
15722025-02-28T06:45:45.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 697.141208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15732025-02-28T06:45:45.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.155890996s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15742025-02-28T06:45:45.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 1.370143859s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15752025-02-28T06:45:45.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.477880708s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
15762025-02-28T06:45:45.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 808.64931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
15772025-02-28T06:45:45.950ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.307459588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15782025-02-28T06:45:45.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.302204338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15792025-02-28T06:45:45.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 662.806141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
15802025-02-28T06:45:46.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 656.118553ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15812025-02-28T06:45:46.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.490679283s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
15822025-02-28T06:45:46.239ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 508.001771ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15832025-02-28T06:45:46.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.419280348s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
15842025-02-28T06:45:46.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.137459923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
15852025-02-28T06:45:46.449ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.391110562s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
15862025-02-28T06:45:46.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.145017493s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
15872025-02-28T06:45:46.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 783.59379ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
15882025-02-28T06:45:46.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 648.394809ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
15892025-02-28T06:45:46.696ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 920.677653ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
15902025-02-28T06:45:46.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 873.25794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
15912025-02-28T06:45:46.735ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.320128111s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
15922025-02-28T06:45:46.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 578.415937ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
15932025-02-28T06:45:46.757ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.020281809s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
15942025-02-28T06:45:46.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.452344265s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
15952025-02-28T06:45:47.044ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 863.186794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
15962025-02-28T06:45:47.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 882.545088ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
15972025-02-28T06:45:47.268ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 810.894556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
15982025-02-28T06:45:47.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 793.377404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
15992025-02-28T06:45:47.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 787.467056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
16002025-02-28T06:45:47.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.424868012s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
16012025-02-28T06:45:47.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 992.40196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16022025-02-28T06:45:47.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 965.688603ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
16032025-02-28T06:45:47.589ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 581.797689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16042025-02-28T06:45:47.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.145096176s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
16052025-02-28T06:45:47.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 1.28093947s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
16062025-02-28T06:45:47.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 662.49127ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
16072025-02-28T06:45:47.707ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 722.805397ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16082025-02-28T06:45:47.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 660.638078ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16092025-02-28T06:45:47.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.371620524s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
16102025-02-28T06:45:47.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.210753106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
16112025-02-28T06:45:47.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 1.222796547s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
16122025-02-28T06:45:48.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 1.331058335s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
16132025-02-28T06:45:48.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.383413023s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
16142025-02-28T06:45:48.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 700.434556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
16152025-02-28T06:45:48.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 571.827853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
16162025-02-28T06:45:48.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 723.236692ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
16172025-02-28T06:45:48.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 995.389986ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16182025-02-28T06:45:48.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.323188951s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
16192025-02-28T06:45:48.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 812.893756ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16202025-02-28T06:45:48.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.475233037s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
16212025-02-28T06:45:48.379ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 853.617987ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
16222025-02-28T06:45:48.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 929.547434ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16232025-02-28T06:45:48.444ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 892.222411ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16242025-02-28T06:45:48.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 973.102696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
16252025-02-28T06:45:48.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 781.609932ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
16262025-02-28T06:45:48.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 875.734766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
16272025-02-28T06:45:48.790ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.155190188s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
16282025-02-28T06:45:48.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 875.027025ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
16292025-02-28T06:45:48.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 973.819362ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
16302025-02-28T06:45:49.072ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 812.721054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
16312025-02-28T06:45:49.152ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 884.054258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
16322025-02-28T06:45:49.167ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.221509627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16332025-02-28T06:45:49.176ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.39259012s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
16342025-02-28T06:45:49.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 929.857911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16352025-02-28T06:45:49.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 912.525079ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
16362025-02-28T06:45:49.329ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.403039565s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16372025-02-28T06:45:49.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.175581107s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16382025-02-28T06:45:49.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 1.432838635s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
16392025-02-28T06:45:49.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.081314443s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
16402025-02-28T06:45:49.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.032319209s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
16412025-02-28T06:45:49.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 673.156154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
16422025-02-28T06:45:49.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.250042595s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
16432025-02-28T06:45:49.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 677.536136ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
16442025-02-28T06:45:49.749ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.416706774s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
16452025-02-28T06:45:49.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.323321299s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
16462025-02-28T06:45:49.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.247775779s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
16472025-02-28T06:45:49.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 540.250718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
16482025-02-28T06:45:49.956ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.101186591s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
16492025-02-28T06:45:50.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 825.889695ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
16502025-02-28T06:45:50.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 944.575447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16512025-02-28T06:45:50.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.383785564s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
16522025-02-28T06:45:50.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.311778172s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
16532025-02-28T06:45:50.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.252479466s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
16542025-02-28T06:45:50.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 749.173714ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16552025-02-28T06:45:50.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 1.393031449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
16562025-02-28T06:45:50.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 592.355855ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16572025-02-28T06:45:50.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.281538847s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
16582025-02-28T06:45:50.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.237292695s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
16592025-02-28T06:45:50.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.07827642s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
16602025-02-28T06:45:50.742ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 604.435458ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16612025-02-28T06:45:50.808ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 545.518715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
16622025-02-28T06:45:50.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 818.923193ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
16632025-02-28T06:45:50.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.388721984s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
16642025-02-28T06:45:51.068ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16652025-02-28T06:45:51.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 501.979214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
16662025-02-28T06:45:51.075ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16672025-02-28T06:45:51.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 647.190736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16682025-02-28T06:45:51.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 567.464828ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16692025-02-28T06:45:51.151ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 933.911124ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
16702025-02-28T06:45:51.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 991.407111ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16712025-02-28T06:45:51.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.381625041s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
16722025-02-28T06:45:51.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 901.51753ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
16732025-02-28T06:45:51.205ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34503
16742025-02-28T06:45:51.273ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49258 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34503 req_id = d6039b54-51fe-4bce-b40c-3030d177ff61 response_code = 200 uri = /baseboard
16752025-02-28T06:45:51.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 42.326207ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16762025-02-28T06:45:51.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 87.457069ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16772025-02-28T06:45:51.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 812.952457ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16782025-02-28T06:45:51.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 1.194096629s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
16792025-02-28T06:45:51.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 131.592838ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16802025-02-28T06:45:51.557ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.372989567s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
16812025-02-28T06:45:51.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 361.94705ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16822025-02-28T06:45:51.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.364761485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
16832025-02-28T06:45:51.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.103325203s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
16842025-02-28T06:45:51.670ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 770.79191ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
16852025-02-28T06:45:51.682ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 789.84146ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
16862025-02-28T06:45:51.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 626.692975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
16872025-02-28T06:45:51.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 861.579456ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
16882025-02-28T06:45:51.747ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 818.794331ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
16892025-02-28T06:45:51.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 877.525581ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
16902025-02-28T06:45:51.839ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 709.230176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
16912025-02-28T06:45:51.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 1.104282737s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
16922025-02-28T06:45:51.950ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 432.758457ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
16932025-02-28T06:45:52.097ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 621.416287ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
16942025-02-28T06:45:52.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.442629082s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
16952025-02-28T06:45:52.167ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.166723703s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
16962025-02-28T06:45:52.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 802.440407ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
16972025-02-28T06:45:52.212ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.10433646s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
16982025-02-28T06:45:52.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 557.888917ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
16992025-02-28T06:45:52.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 834.240499ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
17002025-02-28T06:45:52.397ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 916.735912ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17012025-02-28T06:45:52.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 570.971086ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17022025-02-28T06:45:52.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.268939207s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17032025-02-28T06:45:52.562ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.202175626s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
17042025-02-28T06:45:52.575ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.235118036s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
17052025-02-28T06:45:52.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92") failed: Property not found. retry in 571.304642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
17062025-02-28T06:45:52.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 1.29013818s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
17072025-02-28T06:45:52.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 891.901766ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17082025-02-28T06:45:52.715ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 692.121175ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17092025-02-28T06:45:52.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5") failed: Property not found. retry in 1.0607508s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
17102025-02-28T06:45:52.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.414092831s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
17112025-02-28T06:45:52.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26") failed: Property not found. retry in 1.097501328s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
17122025-02-28T06:45:52.942ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 729.459542ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17132025-02-28T06:45:52.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.397484848s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17142025-02-28T06:45:52.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468") failed: Property not found. retry in 540.86278ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
17152025-02-28T06:45:53.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.015578077s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
17162025-02-28T06:45:53.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 930.022148ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17172025-02-28T06:45:53.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 946.090054ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
17182025-02-28T06:45:53.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 1.004670726s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17192025-02-28T06:45:53.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.409900046s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
17202025-02-28T06:45:53.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.487384804s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17212025-02-28T06:45:53.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.487095657s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17222025-02-28T06:45:53.566ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.311643688s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17232025-02-28T06:45:53.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 882.489791ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17242025-02-28T06:45:53.774ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 578.860486ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17252025-02-28T06:45:53.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 998.239201ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
17262025-02-28T06:45:53.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 906.150925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
17272025-02-28T06:45:53.907ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 576.021622ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
17282025-02-28T06:45:53.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 826.008812ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17292025-02-28T06:45:54.037ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 1.352064385s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
17302025-02-28T06:45:54.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 802.546612ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
17312025-02-28T06:45:54.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 993.713496ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
17322025-02-28T06:45:54.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.10321535s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17332025-02-28T06:45:54.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 1.475830408s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17342025-02-28T06:45:54.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.216667724s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17352025-02-28T06:45:54.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 838.727995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
17362025-02-28T06:45:54.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.051643288s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17372025-02-28T06:45:54.754ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350") failed: Property not found. retry in 1.154861341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
17382025-02-28T06:45:54.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4") failed: Property not found. retry in 1.055885945s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
17392025-02-28T06:45:54.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34") failed: Property not found. retry in 1.367279039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
17402025-02-28T06:45:54.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.099576749s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17412025-02-28T06:45:54.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 637.759827ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17422025-02-28T06:45:54.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.213436662s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17432025-02-28T06:45:54.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8") failed: Property not found. retry in 686.01194ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
17442025-02-28T06:45:55.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 984.950672ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17452025-02-28T06:45:55.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a") failed: Property not found. retry in 1.489059037s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
17462025-02-28T06:45:55.351ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3") failed: Property not found. retry in 660.085542ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
17472025-02-28T06:45:55.400ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 644.298413ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
17482025-02-28T06:45:55.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.379749608s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17492025-02-28T06:45:55.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 990.273962ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17502025-02-28T06:45:55.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.12673581s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17512025-02-28T06:45:55.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 1.344938113s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17522025-02-28T06:45:55.884ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 1.150680975s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17532025-02-28T06:45:55.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 747.755047ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17542025-02-28T06:45:56.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 509.988172ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17552025-02-28T06:45:56.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21") failed: Property not found. retry in 870.368801ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
17562025-02-28T06:45:56.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.325049674s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17572025-02-28T06:45:56.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 683.142443ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17582025-02-28T06:45:56.557ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.099753085s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17592025-02-28T06:45:56.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 1.10066298s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17602025-02-28T06:45:56.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.211926244s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17612025-02-28T06:45:56.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 607.194253ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17622025-02-28T06:45:57.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 619.634134ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17632025-02-28T06:45:57.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 588.759476ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17642025-02-28T06:45:57.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 1.056848478s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17652025-02-28T06:45:57.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2") failed: Property not found. retry in 1.130331934s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17662025-02-28T06:45:57.507ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7") failed: Property not found. retry in 1.250077604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17672025-02-28T06:45:57.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 595.164394ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17682025-02-28T06:45:57.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 687.704564ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17692025-02-28T06:45:57.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 545.331077ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17702025-02-28T06:45:57.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98") failed: Property not found. retry in 866.606595ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17712025-02-28T06:45:57.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c") failed: Property not found. retry in 1.061133787s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17722025-02-28T06:45:58.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547") failed: Property not found. retry in 1.167736766s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17732025-02-28T06:45:58.254ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9") failed: Property not found. retry in 962.725177ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17742025-02-28T06:45:58.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d") failed: Property not found. retry in 679.825929ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17752025-02-28T06:45:58.353ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 1.285864708s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17762025-02-28T06:45:59.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 627.041171ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17772025-02-28T06:46:00.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be") failed: Property not found. retry in 692.324165ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17782025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_17130402-2073-40d7-b72b-01697b9cffc7
17792025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_60dda83b-119e-4091-89bb-47146b9a4e21
17802025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_74a8d1f8-f20f-4b97-a9a0-236ed15e1a34
17812025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_4c6b65a6-1a8a-4846-8854-afbb68a1c5be
17822025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_b6304130-6f89-47cb-94bb-f8a571d2bb98
17832025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_253d80bc-2577-49b2-9a32-b835e93520b5
17842025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_ac5eeddf-55a1-4e19-9d85-9bf1aa17a1f3
17852025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_d6c49f97-8f2b-4a10-a742-f63fd5970a6c
17862025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_f06cf8ec-9e46-4599-a89c-a080b42d9c26
17872025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_44749f91-354a-42ab-b90f-ecccbaaa9350
17882025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_6d7f93d5-671d-4f52-9b87-78d19291764d
17892025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_13017202-14c7-4bde-b922-741839412f92
17902025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_7d6eb2e7-b425-45d2-86bd-6e02b7d4585a
17912025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_118d1ef2-29f5-4549-af1e-9101e16957c8
17922025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_3fd7a640-e26a-4e71-96e9-c971fe868468
17932025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_31d31e90-3f54-42a5-9c6a-3a39893947e4
17942025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_e72f5a53-a61c-40ae-9405-7898df860fb2
17952025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_e8bdae5e-9ded-49bc-b5c4-c0a139701547
17962025-02-28T06:46:01.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_6dfa79a4-7e7e-4b2a-844c-45801a599ee9
17972025-02-28T06:46:01.013ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17982025-02-28T06:46:01.037ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17992025-02-28T06:46:01.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40588335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49447 req_id = 70e67ff0-23d4-4501-be4f-2d9766510481 response_code = 204 uri = /omicron-zones
18002025-02-28T06:46:01.072ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
18012025-02-28T06:46:01.342ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18022025-02-28T06:46:01.370ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
18032025-02-28T06:46:01.406ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
18042025-02-28T06:46:01.426ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18052025-02-28T06:46:01.491ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18062025-02-28T06:46:01.663ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18072025-02-28T06:46:01.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18082025-02-28T06:46:02.012ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18092025-02-28T06:46:02.277ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.345748502s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
18102025-02-28T06:46:02.319ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18112025-02-28T06:46:02.663ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18122025-02-28T06:46:03.034ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18132025-02-28T06:46:03.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18142025-02-28T06:46:03.737ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18152025-02-28T06:46:04.495ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18162025-02-28T06:46:05.419ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18172025-02-28T06:46:05.657ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.136662297s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
18182025-02-28T06:46:06.023ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b221dee6-dc65-449e-974a-6a44e6d144a0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18192025-02-28T06:46:08.320ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "55a2ab4c-5fb9-4b35-b919-bf96a3114040", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b221dee6-dc65-449e-974a-6a44e6d144a0\"", request_id: "55a2ab4c-5fb9-4b35-b919-bf96a3114040" } file = sled-agent/src/rack_setup/service.rs:1065
18202025-02-28T06:46:09.232ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1ed60bde-61af-454e-9b40-9f93d5a5ea8e", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b221dee6-dc65-449e-974a-6a44e6d144a0\"", request_id: "1ed60bde-61af-454e-9b40-9f93d5a5ea8e" } file = sled-agent/src/rack_setup/service.rs:1065
18212025-02-28T06:46:10.331ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "45d19905-c89f-4777-a2e7-1ff0278f5212", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b221dee6-dc65-449e-974a-6a44e6d144a0\"", request_id: "45d19905-c89f-4777-a2e7-1ff0278f5212" } file = sled-agent/src/rack_setup/service.rs:1065
18222025-02-28T06:46:12.593ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "91c0cd7a-6ead-4b12-b5b0-0127bf0983f8", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "91c0cd7a-6ead-4b12-b5b0-0127bf0983f8" } file = sled-agent/src/rack_setup/service.rs:1065
18232025-02-28T06:46:15.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b738a810-491d-4adf-af00-7b02c17c2ee5", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "b738a810-491d-4adf-af00-7b02c17c2ee5" } file = sled-agent/src/rack_setup/service.rs:1065
18242025-02-28T06:46:17.619ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "82f17de9-d4d2-49bc-90fe-27ef9fd15e34", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "82f17de9-d4d2-49bc-90fe-27ef9fd15e34" } file = sled-agent/src/rack_setup/service.rs:1065
18252025-02-28T06:46:21.348ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40655
18262025-02-28T06:46:21.349ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40655 req_id = 18f80c00-b291-4021-9673-b8a41f3b94f5 response_code = 200 uri = /baseboard
18272025-02-28T06:46:21.485ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3e4650f9-bd25-4b3b-a92d-0924bf6c0dd9", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "3e4650f9-bd25-4b3b-a92d-0924bf6c0dd9" } file = sled-agent/src/rack_setup/service.rs:1065
18282025-02-28T06:46:24.010ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "65bb33b9-d118-48c1-917e-6438be0568d4", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "65bb33b9-d118-48c1-917e-6438be0568d4" } file = sled-agent/src/rack_setup/service.rs:1065
18292025-02-28T06:46:26.643ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "147fe323-84bb-4ebd-abd4-792f657e678e", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "147fe323-84bb-4ebd-abd4-792f657e678e" } file = sled-agent/src/rack_setup/service.rs:1065
18302025-02-28T06:46:31.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "df934b2a-fc47-45b2-8e0f-efa3e8df09aa", "content-length": "173", "date": "Fri, 28 Feb 2025 06:46:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9\"", request_id: "df934b2a-fc47-45b2-8e0f-efa3e8df09aa" } file = sled-agent/src/rack_setup/service.rs:1065
18312025-02-28T06:46:33.117ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
18322025-02-28T06:46:33.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55277
18332025-02-28T06:46:33.262ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18342025-02-28T06:46:33.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18352025-02-28T06:46:33.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
18362025-02-28T06:46:33.303ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
18372025-02-28T06:46:33.327ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18382025-02-28T06:46:33.327ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a
18392025-02-28T06:46:33.388ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18402025-02-28T06:46:33.388ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff
18412025-02-28T06:46:33.410ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18422025-02-28T06:46:33.410ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031
18432025-02-28T06:46:33.434ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18442025-02-28T06:46:33.434ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3430e022-7133-4293-ac77-634fd73d7c3b
18452025-02-28T06:46:33.455ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18462025-02-28T06:46:33.455ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36abc0e0-9d49-4738-89cf-f6343849532d
18472025-02-28T06:46:33.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18482025-02-28T06:46:33.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c
18492025-02-28T06:46:33.504ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18502025-02-28T06:46:33.504ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a
18512025-02-28T06:46:33.523ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18522025-02-28T06:46:33.523ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4
18532025-02-28T06:46:33.544ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18542025-02-28T06:46:33.544ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_574faf87-fd2d-44c5-bef4-135771b1853a
18552025-02-28T06:46:33.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 346496 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55277 req_id = ed5ae0ad-da21-4abf-a746-024906e99ed5 response_code = 200 uri = /inventory
18562025-02-28T06:46:39.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50350
18572025-02-28T06:46:39.870ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18582025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18592025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18602025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18622025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632025-02-28T06:46:39.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18642025-02-28T06:46:39.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50350 req_id = 8621d176-13f8-4d76-af9c-b37f8525620b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18652025-02-28T06:46:39.874ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
18662025-02-28T06:46:39.876ZINFOSledAgent (RSS): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18672025-02-28T06:46:39.878ZINFOSledAgent (RSS): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18682025-02-28T06:46:40.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49852
18692025-02-28T06:46:40.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18702025-02-28T06:46:40.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18712025-02-28T06:46:40.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
18722025-02-28T06:46:40.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
18732025-02-28T06:46:40.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18742025-02-28T06:46:40.276ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a
18752025-02-28T06:46:40.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37494
18762025-02-28T06:46:40.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37494 req_id = dc0276b3-2cab-4b6a-81d5-7ac4ab075d41 response_code = 200 uri = /vpc-routes
18772025-02-28T06:46:40.306ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18782025-02-28T06:46:40.306ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff
18792025-02-28T06:46:40.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18802025-02-28T06:46:40.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031
18812025-02-28T06:46:40.370ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18822025-02-28T06:46:40.370ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3430e022-7133-4293-ac77-634fd73d7c3b
18832025-02-28T06:46:40.399ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18842025-02-28T06:46:40.399ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36abc0e0-9d49-4738-89cf-f6343849532d
18852025-02-28T06:46:40.425ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
18862025-02-28T06:46:40.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2887 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37494 req_id = 6092337e-1768-4cd0-b824-9248bd30b631 response_code = 204 uri = /eip-gateways
18872025-02-28T06:46:40.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18882025-02-28T06:46:40.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c
18892025-02-28T06:46:40.453ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18902025-02-28T06:46:40.453ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a
18912025-02-28T06:46:40.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48390
18922025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18932025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18942025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18952025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18962025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18972025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18982025-02-28T06:46:40.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18992025-02-28T06:46:40.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48390 req_id = 960692e2-61ad-4e09-9b28-32cc507d0feb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19002025-02-28T06:46:40.477ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19012025-02-28T06:46:40.477ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4
19022025-02-28T06:46:40.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49815
19032025-02-28T06:46:40.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19042025-02-28T06:46:40.505ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19052025-02-28T06:46:40.505ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_574faf87-fd2d-44c5-bef4-135771b1853a
19062025-02-28T06:46:40.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 256984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49852 req_id = 4dc829fd-6553-464c-82ff-4ba719dbe08c response_code = 200 uri = /inventory
19072025-02-28T06:46:40.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50413
19082025-02-28T06:46:40.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1082 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50413 req_id = a3709fc2-9e19-4a80-ab6e-ddd1edb362a7 response_code = 200 uri = /v2p
19092025-02-28T06:46:40.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19102025-02-28T06:46:40.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49815 req_id = e9fd75b1-9584-43d0-935f-4079383d7c42 response_code = 204 uri = /switch-ports
19112025-02-28T06:46:40.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49815 req_id = baab8af3-0ba1-4d48-bff3-dbb5f9366706 response_code = 200 uri = /network-bootstore-config
19122025-02-28T06:46:40.886ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19132025-02-28T06:46:40.886ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19142025-02-28T06:46:40.888ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19152025-02-28T06:46:40.889ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19162025-02-28T06:46:40.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 13036 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49815 req_id = 75a69a02-6734-42b8-b152-9ce25f0167d9 response_code = 204 uri = /network-bootstore-config
19172025-02-28T06:46:40.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37494 req_id = b60ab06c-6fe3-4474-9f74-847213f8502c response_code = 204 uri = /vpc-routes
19182025-02-28T06:46:40.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50561
19192025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19202025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19222025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19232025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19242025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19252025-02-28T06:46:40.909ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
19262025-02-28T06:46:40.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50561 req_id = d2499346-e79d-4e3a-a6e9-d2f37cc4e706 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19272025-02-28T06:46:41.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47265
19282025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19292025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19302025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19312025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19322025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19332025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19342025-02-28T06:46:41.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
19352025-02-28T06:46:41.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47265 req_id = 3b254dc7-f798-438d-bfc7-f6c5564ad852 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19362025-02-28T06:46:41.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54740
19372025-02-28T06:46:41.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54740 req_id = 2e55677e-8453-40ec-a408-90d0fc76b110 response_code = 200 uri = /vpc-routes
19382025-02-28T06:46:41.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62267
19392025-02-28T06:46:41.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62267 req_id = 4521d854-ec59-40dc-9391-1800659c0deb response_code = 200 uri = /vpc-routes
19402025-02-28T06:46:41.261ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19412025-02-28T06:46:41.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62267 req_id = 012274ab-78ea-4fb5-a8ea-57aba0033a5e response_code = 204 uri = /eip-gateways
19422025-02-28T06:46:41.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19432025-02-28T06:46:41.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54740 req_id = 8d59b050-ee1e-4b43-a86e-84a964310c89 response_code = 204 uri = /eip-gateways
19442025-02-28T06:46:41.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46924
19452025-02-28T06:46:41.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46924 req_id = bebdcf47-fb44-4317-b38e-1036ee276fee response_code = 200 uri = /v2p
19462025-02-28T06:46:41.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54740 req_id = 588d0e73-ac67-4ccd-bace-361aa0688bc6 response_code = 204 uri = /vpc-routes
19472025-02-28T06:46:41.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62267 req_id = eba0fc7c-52b4-46b1-9214-dff21ab8867c response_code = 204 uri = /vpc-routes
19482025-02-28T06:46:41.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50619
19492025-02-28T06:46:41.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19502025-02-28T06:46:41.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19512025-02-28T06:46:41.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50619 req_id = 863a52e3-8b08-4008-8d13-a04c1468decf response_code = 204 uri = /switch-ports
19522025-02-28T06:46:41.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65429
19532025-02-28T06:46:41.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65429 req_id = 8e5f4c66-bce6-4925-8b01-23f4233a945f response_code = 200 uri = /v2p
19542025-02-28T06:46:41.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50619 req_id = a028c93f-752f-4deb-9e15-4dd2d591d68d response_code = 200 uri = /network-bootstore-config
19552025-02-28T06:46:41.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44253
19562025-02-28T06:46:41.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19572025-02-28T06:46:41.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19582025-02-28T06:46:41.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44253 req_id = c0c69382-5531-4938-b6b8-af4deb2de23f response_code = 204 uri = /switch-ports
19592025-02-28T06:46:41.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44253 req_id = 34fed1b3-f927-4e43-b3f8-dfdd575021b0 response_code = 200 uri = /network-bootstore-config
19602025-02-28T06:46:46.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37740
19612025-02-28T06:46:46.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37740 req_id = 83923f22-3a0d-4c7f-bc67-1c99bf944201 response_code = 200 uri = /vpc-routes
19622025-02-28T06:46:46.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19632025-02-28T06:46:46.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37740 req_id = a71b6406-c957-4b6f-9263-87450645f8c3 response_code = 204 uri = /eip-gateways
19642025-02-28T06:46:46.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37740 req_id = 9c669770-75b7-4d5f-a2c4-bb732a7caf7d response_code = 204 uri = /vpc-routes
19652025-02-28T06:46:51.383ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38271
19662025-02-28T06:46:51.383ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38271 req_id = a862042e-3f6d-4d70-ac40-945f79108615 response_code = 200 uri = /baseboard
19672025-02-28T06:46:51.737ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:42813 remote_addr = [fd00:1122:3344:101::d]:46262 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
19682025-02-28T06:46:51.780ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38897 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 4045a988-8bba-429e-a738-f2fb93a1f462 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
19692025-02-28T06:47:10.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43761
19702025-02-28T06:47:10.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43761 req_id = 4e1e8bee-ce81-41e7-8e87-917e35dd7691 response_code = 200 uri = /vpc-routes
19712025-02-28T06:47:10.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58288
19722025-02-28T06:47:10.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58288 req_id = 01fca337-6e5c-4a04-ae9a-37ac82b4600f response_code = 200 uri = /v2p
19732025-02-28T06:47:10.546ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19742025-02-28T06:47:10.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43761 req_id = 42fee8b3-096f-41a5-b169-35c7f25e5008 response_code = 204 uri = /eip-gateways
19752025-02-28T06:47:10.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43761 req_id = c901f322-df56-475d-ba07-8c32a9204199 response_code = 204 uri = /vpc-routes
19762025-02-28T06:47:10.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54179
19772025-02-28T06:47:10.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19782025-02-28T06:47:10.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19792025-02-28T06:47:10.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54179 req_id = 9f8a6c1d-285c-4002-88e6-6f00b92765ea response_code = 204 uri = /switch-ports
19802025-02-28T06:47:10.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54179 req_id = 24673bb4-7b71-43f9-9856-5d16ff2ba3c3 response_code = 200 uri = /network-bootstore-config
19812025-02-28T06:47:11.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41004
19822025-02-28T06:47:11.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41004 req_id = 7378256e-7e0a-4fe8-9b2b-8db73308f710 response_code = 200 uri = /vpc-routes
19832025-02-28T06:47:11.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19842025-02-28T06:47:11.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41004 req_id = 1f85bc3c-7992-4e39-8a0a-4ce32dc2eea4 response_code = 204 uri = /eip-gateways
19852025-02-28T06:47:11.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41004 req_id = 3c278b51-83d5-4388-bb71-53b98af9b5ce response_code = 204 uri = /vpc-routes
19862025-02-28T06:47:11.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36825
19872025-02-28T06:47:11.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36825 req_id = f59111ce-be12-4171-865c-9e9e3d26d006 response_code = 200 uri = /v2p
19882025-02-28T06:47:11.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58114
19892025-02-28T06:47:11.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58114 req_id = 776641b9-0751-43a7-b44b-4bc02486486d response_code = 200 uri = /vpc-routes
19902025-02-28T06:47:11.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
19912025-02-28T06:47:11.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58114 req_id = 9f9cb6ab-f4b5-4b93-a639-cfdd78145561 response_code = 204 uri = /eip-gateways
19922025-02-28T06:47:11.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58114 req_id = 790e411b-879f-4cd3-b31d-2060fcc8b319 response_code = 204 uri = /vpc-routes
19932025-02-28T06:47:11.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32841
19942025-02-28T06:47:11.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32841 req_id = 257a258a-867e-46b6-9f8b-e2bfe958b99a response_code = 200 uri = /v2p
19952025-02-28T06:47:11.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53521
19962025-02-28T06:47:11.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19972025-02-28T06:47:11.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19982025-02-28T06:47:11.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91832 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53521 req_id = 3e44ae30-e2cd-4671-b21e-351624829588 response_code = 204 uri = /switch-ports
19992025-02-28T06:47:11.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53521 req_id = 26c0c056-d789-4f55-bce9-2de6098400fb response_code = 200 uri = /network-bootstore-config
20002025-02-28T06:47:11.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33869
20012025-02-28T06:47:11.781ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20022025-02-28T06:47:11.820ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20032025-02-28T06:47:11.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33869 req_id = 82298984-58ca-4de2-92d5-b99dc9e588c2 response_code = 204 uri = /switch-ports
20042025-02-28T06:47:11.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33869 req_id = 5f61a69a-4184-44c6-84cc-ef3e897df824 response_code = 200 uri = /network-bootstore-config
20052025-02-28T06:47:21.417ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54717
20062025-02-28T06:47:21.418ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54717 req_id = d1e33a06-f0bb-471f-9d06-fac39962ed19 response_code = 200 uri = /baseboard
20072025-02-28T06:47:21.741ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7190 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = ccff6c24-abce-47a9-97bc-fb54a7d42d93 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
20082025-02-28T06:47:40.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63636
20092025-02-28T06:47:40.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63636 req_id = 8d29d077-965e-493d-8437-49aaa169f559 response_code = 200 uri = /vpc-routes
20102025-02-28T06:47:40.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20112025-02-28T06:47:40.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63636 req_id = cab0ab51-525d-49be-92ea-5b28293000e4 response_code = 204 uri = /eip-gateways
20122025-02-28T06:47:40.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63636 req_id = a4739ae8-3738-4e9e-b43b-bf67318ee049 response_code = 204 uri = /vpc-routes
20132025-02-28T06:47:40.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46239
20142025-02-28T06:47:40.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46239 req_id = 95a8cbc1-e0a3-49b2-bb7d-4cabc127b486 response_code = 200 uri = /v2p
20152025-02-28T06:47:40.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56139
20162025-02-28T06:47:40.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20172025-02-28T06:47:40.588ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20182025-02-28T06:47:40.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56139 req_id = 2ecd9167-69c4-4b40-9135-5585236b3831 response_code = 204 uri = /switch-ports
20192025-02-28T06:47:40.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56139 req_id = 340ef083-8828-4467-9925-ab679528945c response_code = 200 uri = /network-bootstore-config
20202025-02-28T06:47:40.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50335
20212025-02-28T06:47:40.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50335 req_id = b5ca0bb5-73f5-4cb1-b832-ca5b3cb90f6f response_code = 200 uri = /vpc-routes
20222025-02-28T06:47:40.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20232025-02-28T06:47:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50335 req_id = 73c26c7e-2819-4743-9faa-061335314401 response_code = 204 uri = /eip-gateways
20242025-02-28T06:47:40.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50335 req_id = a17ceb41-8e59-4340-a372-cccb136e003e response_code = 204 uri = /vpc-routes
20252025-02-28T06:47:41.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35806
20262025-02-28T06:47:41.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20272025-02-28T06:47:41.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20282025-02-28T06:47:41.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35806 req_id = 7c738d85-c954-4c02-8f72-288870f7069d response_code = 204 uri = /switch-ports
20292025-02-28T06:47:41.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35806 req_id = 709c6c4e-b160-4714-a9b8-11e7eade7f99 response_code = 200 uri = /network-bootstore-config
20302025-02-28T06:47:41.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48293
20312025-02-28T06:47:41.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48293 req_id = dc2560ef-476f-47a9-9e35-315920ef4539 response_code = 200 uri = /v2p
20322025-02-28T06:47:41.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44506
20332025-02-28T06:47:41.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44506 req_id = 6f26f0ab-19d4-4ef8-9d4c-ca855dda0a8f response_code = 200 uri = /vpc-routes
20342025-02-28T06:47:41.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20352025-02-28T06:47:41.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44506 req_id = b8970873-dd32-4d86-a3c3-67f71f7494f1 response_code = 204 uri = /eip-gateways
20362025-02-28T06:47:41.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44506 req_id = ea073ac2-4dbf-4de1-ba97-adaf19d2a24e response_code = 204 uri = /vpc-routes
20372025-02-28T06:47:41.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56116
20382025-02-28T06:47:41.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56116 req_id = da0fd515-09cf-4b11-b4a0-8638576deeac response_code = 200 uri = /v2p
20392025-02-28T06:47:41.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60531
20402025-02-28T06:47:41.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20412025-02-28T06:47:41.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20422025-02-28T06:47:41.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60531 req_id = 87be44cf-afc0-4b51-9f7c-4ef63a2beb41 response_code = 204 uri = /switch-ports
20432025-02-28T06:47:41.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60531 req_id = 7c377ad2-cb54-4da9-beb7-7611fd5e4651 response_code = 200 uri = /network-bootstore-config
20442025-02-28T06:47:51.454ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45132
20452025-02-28T06:47:51.454ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45132 req_id = 4e7f71e8-3d55-4fc4-9091-45c7172565d7 response_code = 200 uri = /baseboard
20462025-02-28T06:47:51.741ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7234 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 47cc67ad-4abf-4dc8-9dc9-4e80ae475da1 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
20472025-02-28T06:48:10.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51373
20482025-02-28T06:48:10.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51373 req_id = a55ac1e2-14de-462c-8457-83a43f5021b8 response_code = 200 uri = /vpc-routes
20492025-02-28T06:48:10.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44548
20502025-02-28T06:48:10.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44548 req_id = 765bf9fd-171f-4aae-bbea-76a997fef170 response_code = 200 uri = /v2p
20512025-02-28T06:48:10.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20522025-02-28T06:48:10.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51373 req_id = c3e4ada1-624c-4d82-a46d-581881480bab response_code = 204 uri = /eip-gateways
20532025-02-28T06:48:10.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51373 req_id = 34477671-4d7e-4b88-9f38-95cbb48ce274 response_code = 204 uri = /vpc-routes
20542025-02-28T06:48:10.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51065
20552025-02-28T06:48:10.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20562025-02-28T06:48:10.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20572025-02-28T06:48:10.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51065 req_id = 7a6c664d-90df-4204-a4ce-da5d4e13267e response_code = 204 uri = /switch-ports
20582025-02-28T06:48:10.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51065 req_id = 2f9db521-8139-4f79-bc1b-79277be60ff4 response_code = 200 uri = /network-bootstore-config
20592025-02-28T06:48:11.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51561
20602025-02-28T06:48:11.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51561 req_id = 651dbbd9-c199-4e6c-8be8-e51dcbbd9103 response_code = 200 uri = /vpc-routes
20612025-02-28T06:48:11.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51187
20622025-02-28T06:48:11.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51187 req_id = 501043a1-6f4f-4273-aa20-9b610ee6bb24 response_code = 200 uri = /v2p
20632025-02-28T06:48:11.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20642025-02-28T06:48:11.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51561 req_id = b3af6eb4-9215-4a30-a7fe-092c0e407823 response_code = 204 uri = /eip-gateways
20652025-02-28T06:48:11.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51561 req_id = 2ef68bb4-fe4c-49c5-9087-e2e7fbc577ad response_code = 204 uri = /vpc-routes
20662025-02-28T06:48:11.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48246
20672025-02-28T06:48:11.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20682025-02-28T06:48:11.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20692025-02-28T06:48:11.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48246 req_id = 711787bd-e010-4efb-8fe4-78c493fbbb44 response_code = 204 uri = /switch-ports
20702025-02-28T06:48:11.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62952
20712025-02-28T06:48:11.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62952 req_id = c03ea8d7-b3a5-4eef-a695-cadb5e6e7424 response_code = 200 uri = /vpc-routes
20722025-02-28T06:48:11.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48246 req_id = b5265721-fd6e-493c-b9fd-ca6890a44b5d response_code = 200 uri = /network-bootstore-config
20732025-02-28T06:48:11.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64925
20742025-02-28T06:48:11.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64925 req_id = fd54453a-151b-492f-8e7a-26ea1c2357f7 response_code = 200 uri = /v2p
20752025-02-28T06:48:11.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20762025-02-28T06:48:11.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62952 req_id = 4d19827a-0c10-4ad8-b91d-77f16a04589a response_code = 204 uri = /eip-gateways
20772025-02-28T06:48:11.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62952 req_id = dfc084c6-8bb8-4b62-ae60-5c749ee7de08 response_code = 204 uri = /vpc-routes
20782025-02-28T06:48:11.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51975
20792025-02-28T06:48:11.536ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20802025-02-28T06:48:11.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20812025-02-28T06:48:11.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51975 req_id = 856e10ff-dbd2-465c-9923-5f1986049f85 response_code = 204 uri = /switch-ports
20822025-02-28T06:48:11.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51975 req_id = 169f40a0-8d79-42e8-a27d-67e55535c470 response_code = 200 uri = /network-bootstore-config
20832025-02-28T06:48:21.488ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37979
20842025-02-28T06:48:21.489ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37979 req_id = ee8595a0-120f-4651-a895-4136f4539681 response_code = 200 uri = /baseboard
20852025-02-28T06:48:21.742ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6793 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = fbb4a5ef-6012-439c-a605-2f7ae6d81f13 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
20862025-02-28T06:48:40.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51100
20872025-02-28T06:48:40.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51100 req_id = 8ec8f7aa-072f-4ae4-9448-27d271d28e55 response_code = 200 uri = /vpc-routes
20882025-02-28T06:48:40.260ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
20892025-02-28T06:48:40.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51100 req_id = 56d72ee3-19e3-4986-9c19-2cad97924177 response_code = 204 uri = /eip-gateways
20902025-02-28T06:48:40.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51100 req_id = bd7cf91d-d504-4790-9996-a0f57fa0b5da response_code = 204 uri = /vpc-routes
20912025-02-28T06:48:40.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56035
20922025-02-28T06:48:40.372ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20932025-02-28T06:48:40.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20942025-02-28T06:48:40.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56035 req_id = e0ec71de-1d3d-4a58-b5c1-cc36710cda8b response_code = 204 uri = /switch-ports
20952025-02-28T06:48:40.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40939
20962025-02-28T06:48:40.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40939 req_id = 8ef5a7dd-21eb-4b4a-8b1f-b88683e5fb0b response_code = 200 uri = /v2p
20972025-02-28T06:48:40.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56035 req_id = 4eaa2ed6-84a7-4421-a469-0cd1d733a15b response_code = 200 uri = /network-bootstore-config
20982025-02-28T06:48:40.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60765
20992025-02-28T06:48:40.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60765 req_id = b269a68f-0688-45c8-80d6-1119f0ff97ab response_code = 200 uri = /vpc-routes
21002025-02-28T06:48:41.017ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21012025-02-28T06:48:41.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60765 req_id = e33b021e-2ca5-482f-b0fb-3a91b838f689 response_code = 204 uri = /eip-gateways
21022025-02-28T06:48:41.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60765 req_id = 072dcde9-bdf8-4408-b63a-852c6c7dadf9 response_code = 204 uri = /vpc-routes
21032025-02-28T06:48:41.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63229
21042025-02-28T06:48:41.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21052025-02-28T06:48:41.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21062025-02-28T06:48:41.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124210 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63229 req_id = 0db964b6-b2d2-4dec-a17c-26eeff9be3ca response_code = 204 uri = /switch-ports
21072025-02-28T06:48:41.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57727
21082025-02-28T06:48:41.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57727 req_id = 6b7c60a4-6d04-4008-9493-5a786940d35f response_code = 200 uri = /v2p
21092025-02-28T06:48:41.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63229 req_id = 79e92f39-bd47-4c53-a040-8ffa519b85c8 response_code = 200 uri = /network-bootstore-config
21102025-02-28T06:48:41.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33232
21112025-02-28T06:48:41.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33232 req_id = ac2b3bb2-5e87-42fd-b0a0-833b0dfe383a response_code = 200 uri = /vpc-routes
21122025-02-28T06:48:41.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21132025-02-28T06:48:41.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33232 req_id = 3c1f44c3-2f26-44ae-bba9-1c86fa52643a response_code = 204 uri = /eip-gateways
21142025-02-28T06:48:41.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33232 req_id = fed8ca4c-9600-4384-aa27-33c093ba43c1 response_code = 204 uri = /vpc-routes
21152025-02-28T06:48:41.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41622
21162025-02-28T06:48:41.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21172025-02-28T06:48:41.388ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21182025-02-28T06:48:41.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41622 req_id = 8ec661bf-451f-4044-b21d-83ad7fcb8cbd response_code = 204 uri = /switch-ports
21192025-02-28T06:48:41.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33385
21202025-02-28T06:48:41.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33385 req_id = 6234edeb-3cf1-4792-b078-20cf948d1420 response_code = 200 uri = /v2p
21212025-02-28T06:48:41.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41622 req_id = ac59683c-dcef-4633-add5-a47f3905e10b response_code = 200 uri = /network-bootstore-config
21222025-02-28T06:48:51.523ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48056
21232025-02-28T06:48:51.523ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48056 req_id = ab3f8fde-824b-470c-9872-1e3e4720c473 response_code = 200 uri = /baseboard
21242025-02-28T06:48:51.743ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7767 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 02dc1f4c-4f59-405e-bc20-6e8b90191698 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
21252025-02-28T06:49:01.885ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21262025-02-28T06:49:10.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35165
21272025-02-28T06:49:10.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35165 req_id = 9ebb1da6-6445-42e5-9a3b-9a136e4ace0a response_code = 200 uri = /vpc-routes
21282025-02-28T06:49:10.454ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21292025-02-28T06:49:10.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35165 req_id = 07fc8939-4880-440f-a30c-18a308d8d7ea response_code = 204 uri = /eip-gateways
21302025-02-28T06:49:10.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35165 req_id = e9d22c3e-8017-4c23-8dba-e44d95420950 response_code = 204 uri = /vpc-routes
21312025-02-28T06:49:10.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61113
21322025-02-28T06:49:10.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61113 req_id = 4c67aba2-e35b-4b16-8e78-d90c6b113694 response_code = 200 uri = /v2p
21332025-02-28T06:49:10.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43947
21342025-02-28T06:49:10.654ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21352025-02-28T06:49:10.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21362025-02-28T06:49:10.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43947 req_id = cb8495d0-bb19-48df-a309-dae24fcd68e9 response_code = 204 uri = /switch-ports
21372025-02-28T06:49:10.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43947 req_id = b8f52501-3dbc-4069-9257-851bcca6b799 response_code = 200 uri = /network-bootstore-config
21382025-02-28T06:49:11.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47214
21392025-02-28T06:49:11.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47214 req_id = 6c2e6355-6b7a-421f-a69b-89ca6f47ddd5 response_code = 200 uri = /vpc-routes
21402025-02-28T06:49:11.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21412025-02-28T06:49:11.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47214 req_id = bf138d2f-2a9f-4e58-ac4b-572d71761b31 response_code = 204 uri = /eip-gateways
21422025-02-28T06:49:11.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47214 req_id = 5df06f27-f915-4760-80b1-cb941b939216 response_code = 204 uri = /vpc-routes
21432025-02-28T06:49:11.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53920
21442025-02-28T06:49:11.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53920 req_id = d38991d0-2588-486e-ac4f-6339dad72e2a response_code = 200 uri = /v2p
21452025-02-28T06:49:11.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65109
21462025-02-28T06:49:11.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21472025-02-28T06:49:11.282ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21482025-02-28T06:49:11.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65109 req_id = c961ae12-9465-40ff-979a-a6d458dd2f35 response_code = 204 uri = /switch-ports
21492025-02-28T06:49:11.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65109 req_id = 6ed1f3de-5933-440a-b59d-725c001de680 response_code = 200 uri = /network-bootstore-config
21502025-02-28T06:49:11.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59648
21512025-02-28T06:49:11.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59648 req_id = dad40a3b-380b-4ae8-bc6b-97b1e12ceb2f response_code = 200 uri = /vpc-routes
21522025-02-28T06:49:11.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21532025-02-28T06:49:11.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59648 req_id = cc68ea91-a822-4547-80bc-98bf66c43bc2 response_code = 204 uri = /eip-gateways
21542025-02-28T06:49:11.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59648 req_id = 85cbb3df-94a7-4de1-9b9d-dce0e5c24c7f response_code = 204 uri = /vpc-routes
21552025-02-28T06:49:11.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46728
21562025-02-28T06:49:11.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21572025-02-28T06:49:11.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21582025-02-28T06:49:11.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92152 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46728 req_id = 08712cd4-c232-4b3f-a559-e501dbc627bf response_code = 204 uri = /switch-ports
21592025-02-28T06:49:11.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33500
21602025-02-28T06:49:11.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33500 req_id = f5e0ef46-fc0f-43e8-8fe7-ab516a1daf07 response_code = 200 uri = /v2p
21612025-02-28T06:49:11.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46728 req_id = e16f4905-5a08-4b6c-9511-dfb0986780f2 response_code = 200 uri = /network-bootstore-config
21622025-02-28T06:49:21.564ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60299
21632025-02-28T06:49:21.564ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60299 req_id = f67ef082-2251-4d7c-aee7-e717c650ad6a response_code = 200 uri = /baseboard
21642025-02-28T06:49:21.743ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7533 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 9093c8d3-080d-4bd7-93e5-092d51e9c738 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
21652025-02-28T06:49:40.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64320
21662025-02-28T06:49:40.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64320 req_id = bc4edc8a-5594-49fd-869b-dc44afaf54b3 response_code = 200 uri = /vpc-routes
21672025-02-28T06:49:40.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21682025-02-28T06:49:40.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64320 req_id = 8f4d0ff6-f73d-4a49-a23b-25e72bfe8a98 response_code = 204 uri = /eip-gateways
21692025-02-28T06:49:40.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64320 req_id = bf11f7f1-abf7-45bf-8fec-9794d6018bfe response_code = 204 uri = /vpc-routes
21702025-02-28T06:49:40.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44889
21712025-02-28T06:49:40.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21722025-02-28T06:49:40.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21732025-02-28T06:49:40.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44889 req_id = ccc0cb1b-a190-4a95-a055-94547fa393e3 response_code = 204 uri = /switch-ports
21742025-02-28T06:49:40.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33130
21752025-02-28T06:49:40.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33130 req_id = 6a7b25f7-fae5-45a7-8da0-6424c3d43eb3 response_code = 200 uri = /v2p
21762025-02-28T06:49:40.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44889 req_id = eeda6b01-f02b-444a-b212-fb28a3b086b0 response_code = 200 uri = /network-bootstore-config
21772025-02-28T06:49:40.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61942
21782025-02-28T06:49:40.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61942 req_id = 52368ef6-f4f8-429d-b09b-77050a648444 response_code = 200 uri = /vpc-routes
21792025-02-28T06:49:41.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21802025-02-28T06:49:41.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61942 req_id = a6d14de8-78e4-4d43-8ba6-e1e0009d5ac2 response_code = 204 uri = /eip-gateways
21812025-02-28T06:49:41.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61942 req_id = abe48c0c-adc8-406a-b442-011cd8e5519e response_code = 204 uri = /vpc-routes
21822025-02-28T06:49:41.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48652
21832025-02-28T06:49:41.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48652 req_id = f1780da8-0a97-4ecd-8e77-76d744e5a530 response_code = 200 uri = /v2p
21842025-02-28T06:49:41.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37496
21852025-02-28T06:49:41.229ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21862025-02-28T06:49:41.268ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21872025-02-28T06:49:41.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37496 req_id = f54f878d-ff9f-41a0-b8bd-1d4ef3d70722 response_code = 204 uri = /switch-ports
21882025-02-28T06:49:41.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56223
21892025-02-28T06:49:41.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56223 req_id = 66fae15e-1301-442a-b986-142b0598e8da response_code = 200 uri = /vpc-routes
21902025-02-28T06:49:41.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37496 req_id = a6f30447-64c1-4761-9c24-079de06a6a8f response_code = 200 uri = /network-bootstore-config
21912025-02-28T06:49:41.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
21922025-02-28T06:49:41.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56223 req_id = 4573da66-3d6b-4da9-8266-3dc60567f59b response_code = 204 uri = /eip-gateways
21932025-02-28T06:49:41.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56223 req_id = 19806090-ec06-4fdc-99f7-6735d5257077 response_code = 204 uri = /vpc-routes
21942025-02-28T06:49:41.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63805
21952025-02-28T06:49:41.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63805 req_id = b432da77-31e4-4af3-859f-698ec6fe86a0 response_code = 200 uri = /v2p
21962025-02-28T06:49:41.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63547
21972025-02-28T06:49:41.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21982025-02-28T06:49:41.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21992025-02-28T06:49:41.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91587 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63547 req_id = ef0da592-0736-4364-8934-1e67857a438b response_code = 204 uri = /switch-ports
22002025-02-28T06:49:41.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63547 req_id = 6f9b0661-3a65-4416-8e7f-8e9891d67fa0 response_code = 200 uri = /network-bootstore-config
22012025-02-28T06:49:51.599ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34534
22022025-02-28T06:49:51.599ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34534 req_id = f4f89e17-5112-480a-8f53-6b55321da54a response_code = 200 uri = /baseboard
22032025-02-28T06:49:51.744ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7529 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 2f86a931-2f6f-4c24-97cd-69563024aea9 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
22042025-02-28T06:50:10.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49771
22052025-02-28T06:50:10.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49771 req_id = 56d81eb5-229c-45cd-93ba-373599e3b666 response_code = 200 uri = /v2p
22062025-02-28T06:50:10.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63879
22072025-02-28T06:50:10.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63879 req_id = 1e206e40-3145-4325-b707-cf7104431840 response_code = 200 uri = /vpc-routes
22082025-02-28T06:50:10.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22092025-02-28T06:50:10.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63879 req_id = 960ec24b-74b4-4cc9-9a7b-26eb1b449ac2 response_code = 204 uri = /eip-gateways
22102025-02-28T06:50:10.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63879 req_id = b386043b-7351-4b5c-a505-5d923677d8da response_code = 204 uri = /vpc-routes
22112025-02-28T06:50:10.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46303
22122025-02-28T06:50:10.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22132025-02-28T06:50:10.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22142025-02-28T06:50:10.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46303 req_id = 61cdc5d5-431d-461c-9500-15c8f70fa9ff response_code = 204 uri = /switch-ports
22152025-02-28T06:50:10.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46303 req_id = 4d4ca032-ae78-483b-8586-e0453868a735 response_code = 200 uri = /network-bootstore-config
22162025-02-28T06:50:11.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58700
22172025-02-28T06:50:11.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58700 req_id = b22928e1-80cd-48e2-942b-b5007b11cc7c response_code = 200 uri = /vpc-routes
22182025-02-28T06:50:11.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22192025-02-28T06:50:11.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58700 req_id = 3a0cd8bb-0de4-4311-8114-11eadf627e3e response_code = 204 uri = /eip-gateways
22202025-02-28T06:50:11.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49851
22212025-02-28T06:50:11.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49851 req_id = aa1bb2d4-1829-4446-a4a5-1394fffd973d response_code = 200 uri = /v2p
22222025-02-28T06:50:11.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58700 req_id = bd666282-5762-495c-b844-f294c4785e87 response_code = 204 uri = /vpc-routes
22232025-02-28T06:50:11.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50921
22242025-02-28T06:50:11.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50921 req_id = 7917a196-0891-4d93-9441-a06fbfaf35f1 response_code = 200 uri = /vpc-routes
22252025-02-28T06:50:11.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41992
22262025-02-28T06:50:11.524ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22272025-02-28T06:50:11.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22282025-02-28T06:50:11.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41992 req_id = f99d5404-ca55-446f-8793-4960e3cdb557 response_code = 204 uri = /switch-ports
22292025-02-28T06:50:11.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44000
22302025-02-28T06:50:11.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55181
22312025-02-28T06:50:11.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22322025-02-28T06:50:11.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22332025-02-28T06:50:11.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50921 req_id = 52d88540-f279-4ebd-bf13-cb855eea0155 response_code = 204 uri = /eip-gateways
22342025-02-28T06:50:11.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3975 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41992 req_id = dcad169c-8db7-49b2-a221-408acb3b50f3 response_code = 200 uri = /network-bootstore-config
22352025-02-28T06:50:11.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44000 req_id = 525b2cf9-9d8f-40b8-b9b7-7d16d4a1cc05 response_code = 200 uri = /v2p
22362025-02-28T06:50:11.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50921 req_id = f48c3212-e6a0-43e2-b56a-af87fb8af0b1 response_code = 204 uri = /vpc-routes
22372025-02-28T06:50:11.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22382025-02-28T06:50:11.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55181 req_id = 1b52558a-646f-4ca5-b158-e1aacf450757 response_code = 204 uri = /switch-ports
22392025-02-28T06:50:11.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55181 req_id = 02a4498a-3663-4aec-9d05-22a83ecb899e response_code = 200 uri = /network-bootstore-config
22402025-02-28T06:50:21.631ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53770
22412025-02-28T06:50:21.631ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53770 req_id = 1bb64a29-3eee-498c-8bda-1ad5a398a490 response_code = 200 uri = /baseboard
22422025-02-28T06:50:21.745ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7917 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = f311b94c-141b-44eb-8a4c-3d7ac655d9d5 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
22432025-02-28T06:50:40.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43957
22442025-02-28T06:50:40.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43957 req_id = 3bc97cc8-f88d-4b12-9a26-78eb640d41e5 response_code = 200 uri = /vpc-routes
22452025-02-28T06:50:40.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49811
22462025-02-28T06:50:40.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49811 req_id = 90e1e0e9-c45f-4efc-97ab-04d2ff347e3f response_code = 200 uri = /v2p
22472025-02-28T06:50:40.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22482025-02-28T06:50:40.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43957 req_id = efbbf1e7-fefd-423b-8aeb-25d37acc6510 response_code = 204 uri = /eip-gateways
22492025-02-28T06:50:40.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43957 req_id = b3b0c4fb-47ef-4ada-9863-357fa4e91b70 response_code = 204 uri = /vpc-routes
22502025-02-28T06:50:40.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34480
22512025-02-28T06:50:40.372ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22522025-02-28T06:50:40.406ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22532025-02-28T06:50:40.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77793 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34480 req_id = 1eef4dde-bf75-48a2-af4e-20c472b2e783 response_code = 204 uri = /switch-ports
22542025-02-28T06:50:40.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34480 req_id = 05173a04-16dd-473a-a2d2-a8852871c575 response_code = 200 uri = /network-bootstore-config
22552025-02-28T06:50:40.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53670
22562025-02-28T06:50:40.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53670 req_id = 67f9ce4d-4b89-456b-ba9a-dff833058a62 response_code = 200 uri = /vpc-routes
22572025-02-28T06:50:40.995ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22582025-02-28T06:50:40.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53670 req_id = 8748ac71-f87a-4a96-b3ad-0a5983905fbe response_code = 204 uri = /eip-gateways
22592025-02-28T06:50:41.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53670 req_id = 47fab4db-b3de-4be6-9980-caa258385bdc response_code = 204 uri = /vpc-routes
22602025-02-28T06:50:41.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35227
22612025-02-28T06:50:41.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35227 req_id = 30c0bd75-354c-41c4-bff0-19940b4d3780 response_code = 200 uri = /v2p
22622025-02-28T06:50:41.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49033
22632025-02-28T06:50:41.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22642025-02-28T06:50:41.103ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22652025-02-28T06:50:41.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49033 req_id = f1ea77e3-0428-4bc1-afe6-51e128f2b653 response_code = 204 uri = /switch-ports
22662025-02-28T06:50:41.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49033 req_id = 0db81943-e27f-4fcf-b2fe-007406c8f9a0 response_code = 200 uri = /network-bootstore-config
22672025-02-28T06:50:41.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55401
22682025-02-28T06:50:41.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55401 req_id = 8edb11c8-244c-4279-b156-eaed17f9cf0f response_code = 200 uri = /vpc-routes
22692025-02-28T06:50:41.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22702025-02-28T06:50:41.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55401 req_id = 37aed47e-0a5c-4ae3-8395-007fb59a1f59 response_code = 204 uri = /eip-gateways
22712025-02-28T06:50:41.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45576
22722025-02-28T06:50:41.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45576 req_id = 8eeefe84-6178-4e0d-a51d-9a1a474321f8 response_code = 200 uri = /v2p
22732025-02-28T06:50:41.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55401 req_id = 3cfe938a-0a93-474a-b0c1-9ea8a742400b response_code = 204 uri = /vpc-routes
22742025-02-28T06:50:41.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38361
22752025-02-28T06:50:41.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22762025-02-28T06:50:41.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22772025-02-28T06:50:41.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38361 req_id = bcdb70c5-eac6-43a7-8b43-f91615aaffe3 response_code = 204 uri = /switch-ports
22782025-02-28T06:50:41.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38361 req_id = 2ab7047a-c8bc-45f8-bebd-5b058ec8fd69 response_code = 200 uri = /network-bootstore-config
22792025-02-28T06:50:51.665ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58448
22802025-02-28T06:50:51.665ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58448 req_id = 181e8c5c-c4ac-478d-a63d-050c0021b573 response_code = 200 uri = /baseboard
22812025-02-28T06:50:51.745ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7646 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 708b7fdc-5b38-44d0-bd70-ea333778a82e response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
22822025-02-28T06:51:10.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52879
22832025-02-28T06:51:10.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22842025-02-28T06:51:10.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52879 req_id = 76e31a4b-fe0e-49bf-bcb6-5f7277cbb4f5 response_code = 200 uri = /artifacts
22852025-02-28T06:51:10.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55587
22862025-02-28T06:51:10.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55587 req_id = 60ee29d4-e522-4b07-9260-ccd21c39c2dc response_code = 200 uri = /vpc-routes
22872025-02-28T06:51:10.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
22882025-02-28T06:51:10.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55587 req_id = 9ac5e821-db48-4c1a-af6d-a40eb3acc04c response_code = 204 uri = /eip-gateways
22892025-02-28T06:51:10.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55587 req_id = 3142b9f2-8840-4046-9e42-3dc52e0b10e6 response_code = 204 uri = /vpc-routes
22902025-02-28T06:51:10.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65192
22912025-02-28T06:51:10.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22922025-02-28T06:51:10.559ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22932025-02-28T06:51:10.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97790 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65192 req_id = 6e040835-e9b7-4909-9420-a2c9ed7ffab8 response_code = 204 uri = /switch-ports
22942025-02-28T06:51:10.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65192 req_id = a005e550-8032-4584-8f04-b98d8d46dec3 response_code = 200 uri = /network-bootstore-config
22952025-02-28T06:51:10.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56798
22962025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22972025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22982025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22992025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23002025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23012025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23022025-02-28T06:51:10.618ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23032025-02-28T06:51:10.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56798 req_id = 849b750f-c103-4bfb-8027-20523769bb74 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23042025-02-28T06:51:10.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33791
23052025-02-28T06:51:10.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33791 req_id = 418ad743-14cb-4b91-aa5a-c47e0ae39ae4 response_code = 200 uri = /v2p
23062025-02-28T06:51:11.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34787
23072025-02-28T06:51:11.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34787 req_id = c0d9005f-dc2c-40bb-b4d0-44912fef5c7e response_code = 200 uri = /vpc-routes
23082025-02-28T06:51:11.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33940
23092025-02-28T06:51:11.198ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23102025-02-28T06:51:11.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33940 req_id = 0c20f855-8ec8-468d-97df-a5c044aa8b53 response_code = 200 uri = /artifacts
23112025-02-28T06:51:11.205ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23122025-02-28T06:51:11.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34787 req_id = 9d249f21-ab68-4b26-bab3-8cbff51e40ff response_code = 204 uri = /eip-gateways
23132025-02-28T06:51:11.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62119
23142025-02-28T06:51:11.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62119 req_id = e8aa7a40-a1fd-4b18-b940-371cc8456bf2 response_code = 200 uri = /v2p
23152025-02-28T06:51:11.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34787 req_id = 159ecff3-4c62-4331-858e-2b377e9cfe1b response_code = 204 uri = /vpc-routes
23162025-02-28T06:51:11.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62008
23172025-02-28T06:51:11.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23182025-02-28T06:51:11.449ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23192025-02-28T06:51:11.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62008 req_id = f363beab-6424-4e09-819a-24551304e03e response_code = 204 uri = /switch-ports
23202025-02-28T06:51:11.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35013
23212025-02-28T06:51:11.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62008 req_id = bf78bcac-ea89-407d-b93f-3e51a6f8a917 response_code = 200 uri = /network-bootstore-config
23222025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23232025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23242025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23252025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23262025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23272025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23282025-02-28T06:51:11.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23292025-02-28T06:51:11.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35013 req_id = b93f00fb-fd67-4762-8150-bfb0eb45abcc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23302025-02-28T06:51:11.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34744
23312025-02-28T06:51:11.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23322025-02-28T06:51:11.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34744 req_id = d494dd15-f3e6-4e43-aa0a-0e768b4eea5e response_code = 200 uri = /artifacts
23332025-02-28T06:51:11.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34003
23342025-02-28T06:51:11.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34003 req_id = 6cb1b744-0db6-467b-a03d-88f7a90cc86c response_code = 200 uri = /vpc-routes
23352025-02-28T06:51:11.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54515
23362025-02-28T06:51:11.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54515 req_id = 35e3b5fb-fd80-40d2-b60f-15416006be11 response_code = 200 uri = /v2p
23372025-02-28T06:51:11.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39327
23382025-02-28T06:51:11.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23392025-02-28T06:51:11.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23402025-02-28T06:51:11.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39327 req_id = 0e33a700-20cd-4538-a604-131d7d517448 response_code = 204 uri = /switch-ports
23412025-02-28T06:51:11.739ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23422025-02-28T06:51:11.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34003 req_id = fbe2fdf5-a37f-4902-8fc6-85eb56da85fc response_code = 204 uri = /eip-gateways
23432025-02-28T06:51:11.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39327 req_id = 396e54c5-b3b8-4787-b1e2-7b55c5a7b428 response_code = 200 uri = /network-bootstore-config
23442025-02-28T06:51:11.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48337
23452025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23462025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23472025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23482025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23492025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23502025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23512025-02-28T06:51:11.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23522025-02-28T06:51:11.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48337 req_id = c8ed066b-4f2d-409e-8a90-cec6cfe29f98 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23532025-02-28T06:51:11.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34003 req_id = 3fb1188e-721a-4470-834b-f70040589d84 response_code = 204 uri = /vpc-routes
23542025-02-28T06:51:21.699ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56496
23552025-02-28T06:51:21.699ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56496 req_id = fc81e672-7638-4c0d-9b15-6567062eab5b response_code = 200 uri = /baseboard
23562025-02-28T06:51:21.746ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7959 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 040830c5-1f88-4260-b231-d3f12ce16613 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
23572025-02-28T06:51:40.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43285
23582025-02-28T06:51:40.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43285 req_id = b87d7a8c-e1fb-40aa-af8f-1a183dd5a4b2 response_code = 200 uri = /vpc-routes
23592025-02-28T06:51:40.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23602025-02-28T06:51:40.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43285 req_id = 2b9dd4ee-368c-4892-9f11-5460daa3e467 response_code = 204 uri = /eip-gateways
23612025-02-28T06:51:40.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43285 req_id = ef152088-5ea3-4013-817a-531c188cddaa response_code = 204 uri = /vpc-routes
23622025-02-28T06:51:40.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52335
23632025-02-28T06:51:40.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52335 req_id = 6bf12850-a2e6-41cc-851a-78ad697b3398 response_code = 200 uri = /v2p
23642025-02-28T06:51:40.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64589
23652025-02-28T06:51:40.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23662025-02-28T06:51:40.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23672025-02-28T06:51:40.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64589 req_id = 046ff494-91cc-440e-b11e-5fed6d31e8cd response_code = 204 uri = /switch-ports
23682025-02-28T06:51:40.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64589 req_id = 05131347-9bcf-4cce-adeb-e86511d5a47b response_code = 200 uri = /network-bootstore-config
23692025-02-28T06:51:40.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44328
23702025-02-28T06:51:40.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44328 req_id = 69437543-02d7-4008-a939-e35d73de9cd0 response_code = 200 uri = /vpc-routes
23712025-02-28T06:51:40.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23722025-02-28T06:51:40.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44328 req_id = dfebc897-a88e-4221-b6ea-7cfe350ff1bf response_code = 204 uri = /eip-gateways
23732025-02-28T06:51:41.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44328 req_id = 244989f9-704c-441d-8754-bc97111aaf6d response_code = 204 uri = /vpc-routes
23742025-02-28T06:51:41.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49269
23752025-02-28T06:51:41.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49269 req_id = 3f628ca6-cee9-4cdb-a329-a08927c3ad36 response_code = 200 uri = /v2p
23762025-02-28T06:51:41.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40584
23772025-02-28T06:51:41.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40584 req_id = 5db60154-1abe-4ed9-9f93-3c2edffb62c5 response_code = 200 uri = /vpc-routes
23782025-02-28T06:51:41.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36362
23792025-02-28T06:51:41.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23802025-02-28T06:51:41.265ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23812025-02-28T06:51:41.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98818 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36362 req_id = 651f0da3-d026-41f4-9893-377b259d482d response_code = 204 uri = /switch-ports
23822025-02-28T06:51:41.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65232
23832025-02-28T06:51:41.325ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23842025-02-28T06:51:41.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36362 req_id = 9f7ce06b-a192-4a0e-8875-fac0da14dd0b response_code = 200 uri = /network-bootstore-config
23852025-02-28T06:51:41.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40584 req_id = 1a5c70dd-da24-4d3e-ae8f-c22fa2f15964 response_code = 204 uri = /eip-gateways
23862025-02-28T06:51:41.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23872025-02-28T06:51:41.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40584 req_id = ec54746a-d15d-48d1-b910-2a17b261bb09 response_code = 204 uri = /vpc-routes
23882025-02-28T06:51:41.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61529
23892025-02-28T06:51:41.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61529 req_id = c87a92a6-74f4-4831-ad42-d09ef7640a36 response_code = 200 uri = /v2p
23902025-02-28T06:51:41.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23912025-02-28T06:51:41.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65232 req_id = b7a6dbf7-70b3-4dd4-b691-5793573ac134 response_code = 204 uri = /switch-ports
23922025-02-28T06:51:41.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65232 req_id = 71b26a1d-381c-4f35-b550-08d4953f10fb response_code = 200 uri = /network-bootstore-config
23932025-02-28T06:51:51.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48167
23942025-02-28T06:51:51.734ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48167 req_id = 044177c0-a57c-445f-95c7-1d4c7fbdfa26 response_code = 200 uri = /baseboard
23952025-02-28T06:51:51.746ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7776 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 7e793705-454f-4703-bccc-3c3b412b460e response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
23962025-02-28T06:52:10.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51875
23972025-02-28T06:52:10.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51875 req_id = 84b7b59d-3af6-47a5-845c-9457035b7c39 response_code = 200 uri = /vpc-routes
23982025-02-28T06:52:10.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
23992025-02-28T06:52:10.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51875 req_id = f7e92443-0da9-4c82-86ab-5f3601245a93 response_code = 204 uri = /eip-gateways
24002025-02-28T06:52:10.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51875 req_id = ec5396f2-fe03-4cc9-8249-05fddd237eba response_code = 204 uri = /vpc-routes
24012025-02-28T06:52:10.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33921
24022025-02-28T06:52:10.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24032025-02-28T06:52:10.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24042025-02-28T06:52:10.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33921 req_id = c2d6b208-f8a6-4870-a155-5cb69874e6b0 response_code = 204 uri = /switch-ports
24052025-02-28T06:52:10.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33780
24062025-02-28T06:52:10.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33780 req_id = 5d205197-db94-4ccc-986f-d9aa98e63f98 response_code = 200 uri = /v2p
24072025-02-28T06:52:10.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33921 req_id = e608e08c-5c6d-489d-8a41-8982a6a0c0f1 response_code = 200 uri = /network-bootstore-config
24082025-02-28T06:52:11.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42512
24092025-02-28T06:52:11.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42512 req_id = cbbab24c-c7aa-4853-8cb3-7c72b7e74ade response_code = 200 uri = /vpc-routes
24102025-02-28T06:52:11.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24112025-02-28T06:52:11.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42512 req_id = b1ffbb03-7edc-4554-ad49-28139560c53e response_code = 204 uri = /eip-gateways
24122025-02-28T06:52:11.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47419
24132025-02-28T06:52:11.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47419 req_id = 76e072b3-69ff-4dcc-ab52-d485a9f8cfd8 response_code = 200 uri = /vpc-routes
24142025-02-28T06:52:11.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62618
24152025-02-28T06:52:11.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62618 req_id = 4782d03f-e9fb-44b2-ac03-05ff0d76d158 response_code = 200 uri = /v2p
24162025-02-28T06:52:11.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42512 req_id = bf400f52-52b4-43ea-a2a4-e7f849717640 response_code = 204 uri = /vpc-routes
24172025-02-28T06:52:11.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24182025-02-28T06:52:11.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47419 req_id = 8aa6b0fd-bdf0-4912-baaa-d8e9d08a1efb response_code = 204 uri = /eip-gateways
24192025-02-28T06:52:11.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47080
24202025-02-28T06:52:11.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47080 req_id = bc1cbe6e-4d96-467f-bdf6-160acbeb2d37 response_code = 200 uri = /v2p
24212025-02-28T06:52:11.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47419 req_id = 2117e1d6-74fb-4e7c-b3d6-3a06fcac4b4e response_code = 204 uri = /vpc-routes
24222025-02-28T06:52:11.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48249
24232025-02-28T06:52:11.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24242025-02-28T06:52:11.493ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24252025-02-28T06:52:11.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48249 req_id = f5354ea0-b0e0-43f9-b2c9-6cadc6d5c0b1 response_code = 204 uri = /switch-ports
24262025-02-28T06:52:11.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56618
24272025-02-28T06:52:11.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48249 req_id = 3fb5e6f3-e5d6-4f0b-966b-3184bf1d9305 response_code = 200 uri = /network-bootstore-config
24282025-02-28T06:52:11.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24292025-02-28T06:52:11.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24302025-02-28T06:52:11.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56618 req_id = 997c3098-24d3-40cc-85dc-354d094924a1 response_code = 204 uri = /switch-ports
24312025-02-28T06:52:11.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56618 req_id = 1f392bbe-1dd9-4c1d-a57c-2de291b220d1 response_code = 200 uri = /network-bootstore-config
24322025-02-28T06:52:21.746ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7090 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = db77ef24-2e7d-4182-9b0c-c84a809e6736 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
24332025-02-28T06:52:21.768ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55004
24342025-02-28T06:52:21.768ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55004 req_id = 4f24a5e3-d50f-4527-8498-5d66c472e1c5 response_code = 200 uri = /baseboard
24352025-02-28T06:52:40.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41481
24362025-02-28T06:52:40.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41481 req_id = 6f382f38-7f76-4ae8-a918-56e666835610 response_code = 200 uri = /vpc-routes
24372025-02-28T06:52:40.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24382025-02-28T06:52:40.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41481 req_id = 7fc6e2dc-5aad-4519-a5bc-9fb87d8115e1 response_code = 204 uri = /eip-gateways
24392025-02-28T06:52:40.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41481 req_id = 0e6c3bc7-3ee5-4400-b414-4cffbb1cb519 response_code = 204 uri = /vpc-routes
24402025-02-28T06:52:40.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54756
24412025-02-28T06:52:40.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24422025-02-28T06:52:40.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24432025-02-28T06:52:40.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54756 req_id = a1e48927-7b1d-4fe5-a885-aff5fe3e8969 response_code = 204 uri = /switch-ports
24442025-02-28T06:52:40.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60198
24452025-02-28T06:52:40.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54756 req_id = 8a2c3650-22bd-4a6c-b54b-bb382aa0d0d7 response_code = 200 uri = /network-bootstore-config
24462025-02-28T06:52:40.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60198 req_id = 878a8685-1613-49fd-92da-e8fce45c2405 response_code = 200 uri = /v2p
24472025-02-28T06:52:41.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38875
24482025-02-28T06:52:41.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38875 req_id = 6ee1c356-b010-4af1-b5d0-fa250b0bd98c response_code = 200 uri = /vpc-routes
24492025-02-28T06:52:41.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41646
24502025-02-28T06:52:41.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41646 req_id = 83a65c03-9802-4ade-a61f-b4989f4cc4b5 response_code = 200 uri = /v2p
24512025-02-28T06:52:41.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24522025-02-28T06:52:41.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38875 req_id = 0a33ea97-f99f-4e76-b21e-cd5ff42ffd7b response_code = 204 uri = /eip-gateways
24532025-02-28T06:52:41.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38875 req_id = 0458b6cf-a324-47ec-a773-fc0ea9af45f0 response_code = 204 uri = /vpc-routes
24542025-02-28T06:52:41.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54352
24552025-02-28T06:52:41.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24562025-02-28T06:52:41.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24572025-02-28T06:52:41.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54352 req_id = 78668256-49da-4738-9ff7-d9b4624f0fe5 response_code = 204 uri = /switch-ports
24582025-02-28T06:52:41.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34412
24592025-02-28T06:52:41.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34412 req_id = 58f1df40-4deb-46fe-9c7e-c2bb7a73f976 response_code = 200 uri = /v2p
24602025-02-28T06:52:41.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54352 req_id = f690d961-667a-484f-9f8a-5c53d436b34a response_code = 200 uri = /network-bootstore-config
24612025-02-28T06:52:41.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37893
24622025-02-28T06:52:41.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37893 req_id = 63b647ed-b6fe-46f1-a27c-6c08c34c5712 response_code = 200 uri = /vpc-routes
24632025-02-28T06:52:41.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24642025-02-28T06:52:41.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37893 req_id = 922a4167-e7ae-48cb-8323-e392147fcb65 response_code = 204 uri = /eip-gateways
24652025-02-28T06:52:41.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37893 req_id = b2602fce-3f52-4388-9175-b6aa5a94e9a6 response_code = 204 uri = /vpc-routes
24662025-02-28T06:52:41.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57895
24672025-02-28T06:52:41.329ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24682025-02-28T06:52:41.366ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24692025-02-28T06:52:41.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92592 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57895 req_id = 52788010-db46-48de-a947-2dbe3c3684cc response_code = 204 uri = /switch-ports
24702025-02-28T06:52:41.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57895 req_id = 2774b2fb-26ac-42b9-9d00-d8a2e36b8e8c response_code = 200 uri = /network-bootstore-config
24712025-02-28T06:52:51.747ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8176 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 8fb638f6-1256-4720-9c5a-5c1214d82b3a response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
24722025-02-28T06:52:51.803ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49633
24732025-02-28T06:52:51.803ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49633 req_id = ce247706-22ee-4b25-a278-0de02d6d4c35 response_code = 200 uri = /baseboard
24742025-02-28T06:53:10.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34098
24752025-02-28T06:53:10.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34098 req_id = 13d66602-53c2-47c8-948c-ccdbcf257d00 response_code = 200 uri = /v2p
24762025-02-28T06:53:10.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49940
24772025-02-28T06:53:10.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49940 req_id = 58692add-0fb5-4ed7-ae1a-6c64b009746d response_code = 200 uri = /vpc-routes
24782025-02-28T06:53:10.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24792025-02-28T06:53:10.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49940 req_id = 7c824d5a-016f-4367-b211-3bb1d8025117 response_code = 204 uri = /eip-gateways
24802025-02-28T06:53:10.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49940 req_id = 80cfecf4-22d2-4ee5-8c80-54dfdaefc37f response_code = 204 uri = /vpc-routes
24812025-02-28T06:53:10.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32984
24822025-02-28T06:53:10.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24832025-02-28T06:53:10.647ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24842025-02-28T06:53:10.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32984 req_id = 4e862d03-340d-4a05-9f69-f0cd06b8b124 response_code = 204 uri = /switch-ports
24852025-02-28T06:53:10.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32984 req_id = 7aed41f5-f5e3-4b88-9919-6891d63a89c9 response_code = 200 uri = /network-bootstore-config
24862025-02-28T06:53:11.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59856
24872025-02-28T06:53:11.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59856 req_id = 878b9de1-7b9b-4623-9726-64542d381efc response_code = 200 uri = /vpc-routes
24882025-02-28T06:53:11.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
24892025-02-28T06:53:11.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59856 req_id = bcbe2c12-e2c3-4f0d-9d7f-b9f0f1793e4b response_code = 204 uri = /eip-gateways
24902025-02-28T06:53:11.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59856 req_id = a3a8f40c-7a47-4a22-892c-f26da73fc8ba response_code = 204 uri = /vpc-routes
24912025-02-28T06:53:11.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58945
24922025-02-28T06:53:11.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24932025-02-28T06:53:11.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24942025-02-28T06:53:11.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58945 req_id = 24dc6627-d001-420e-8f0a-6c28c29a33ad response_code = 204 uri = /switch-ports
24952025-02-28T06:53:11.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37122
24962025-02-28T06:53:11.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43176
24972025-02-28T06:53:11.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43176 req_id = 38e0151c-c3cb-44cc-b948-662ad33d06f6 response_code = 200 uri = /v2p
24982025-02-28T06:53:11.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37122 req_id = 39e0f67a-2d3f-4173-b4ba-4df9503a63fc response_code = 200 uri = /vpc-routes
24992025-02-28T06:53:11.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58945 req_id = 9b4043a8-80f3-416c-b86e-e6c788e32c7a response_code = 200 uri = /network-bootstore-config
25002025-02-28T06:53:11.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25012025-02-28T06:53:11.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37122 req_id = 4a0d4126-73c2-4153-9284-b45a50894079 response_code = 204 uri = /eip-gateways
25022025-02-28T06:53:11.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44579
25032025-02-28T06:53:11.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44579 req_id = 779aaf2a-56ce-40b3-bd3c-7b846fcd0fec response_code = 200 uri = /v2p
25042025-02-28T06:53:11.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37122 req_id = 8cd2e9ee-0df8-4b00-8260-a9ec021b89f1 response_code = 204 uri = /vpc-routes
25052025-02-28T06:53:11.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52346
25062025-02-28T06:53:11.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25072025-02-28T06:53:11.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25082025-02-28T06:53:11.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52346 req_id = 935483d3-db75-420e-9277-4763199bb0e2 response_code = 204 uri = /switch-ports
25092025-02-28T06:53:11.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52346 req_id = 9920e7c8-364e-4532-abc8-cd8c831f9ae5 response_code = 200 uri = /network-bootstore-config
25102025-02-28T06:53:21.747ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7126 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = d04f415d-a0c3-422a-aa72-f577b2ee7b17 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
25112025-02-28T06:53:21.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41923
25122025-02-28T06:53:21.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41923 req_id = 994fb6a3-d88d-45c4-aad8-0bc9ac6c6ed1 response_code = 200 uri = /baseboard
25132025-02-28T06:53:40.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61929
25142025-02-28T06:53:40.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61929 req_id = eab43c3e-252c-4336-ae20-133d31cb9150 response_code = 200 uri = /vpc-routes
25152025-02-28T06:53:40.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25162025-02-28T06:53:40.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61929 req_id = 55f04663-c6d9-4303-b3cb-adac78ab5dab response_code = 204 uri = /eip-gateways
25172025-02-28T06:53:40.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61929 req_id = 34dfd197-0328-4341-9cc0-2746a05f9458 response_code = 204 uri = /vpc-routes
25182025-02-28T06:53:40.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35091
25192025-02-28T06:53:40.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25202025-02-28T06:53:40.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25212025-02-28T06:53:40.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35091 req_id = e3a17b2b-a650-4024-8746-a089e3b03792 response_code = 204 uri = /switch-ports
25222025-02-28T06:53:40.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37239
25232025-02-28T06:53:40.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37239 req_id = dfc770aa-42cd-4d54-a3b3-ab4c88e280f4 response_code = 200 uri = /v2p
25242025-02-28T06:53:40.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35091 req_id = 0ba200f4-58a3-48a1-abab-90cde330577b response_code = 200 uri = /network-bootstore-config
25252025-02-28T06:53:40.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36515
25262025-02-28T06:53:40.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36515 req_id = cdae7e54-c9bb-40f5-8720-e27a197b5459 response_code = 200 uri = /vpc-routes
25272025-02-28T06:53:41.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25282025-02-28T06:53:41.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36515 req_id = 18380c55-d3b9-4ecc-b74b-e230e6d8e0cf response_code = 204 uri = /eip-gateways
25292025-02-28T06:53:41.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36515 req_id = 88f0540e-464a-475a-974b-741aba8669b8 response_code = 204 uri = /vpc-routes
25302025-02-28T06:53:41.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61859
25312025-02-28T06:53:41.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25322025-02-28T06:53:41.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25332025-02-28T06:53:41.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61859 req_id = 87354b9a-41bc-4642-94f8-e0de9a0a2aa2 response_code = 204 uri = /switch-ports
25342025-02-28T06:53:41.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61859 req_id = a543393e-5fe1-49ce-b46a-2603b33e8a37 response_code = 200 uri = /network-bootstore-config
25352025-02-28T06:53:41.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62225
25362025-02-28T06:53:41.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62225 req_id = 70613303-1ef1-48c8-80b5-64d860cf66cd response_code = 200 uri = /v2p
25372025-02-28T06:53:41.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34723
25382025-02-28T06:53:41.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34723 req_id = 3fa45f4f-a7f0-41f9-b0c4-e1c49be237d1 response_code = 200 uri = /vpc-routes
25392025-02-28T06:53:41.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25402025-02-28T06:53:41.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34723 req_id = 62a67de5-4b10-4181-9b5f-ae511c71051f response_code = 204 uri = /eip-gateways
25412025-02-28T06:53:41.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34723 req_id = c547ca74-3704-44c7-9909-e5a8a6bfb0e4 response_code = 204 uri = /vpc-routes
25422025-02-28T06:53:41.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52050
25432025-02-28T06:53:41.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25442025-02-28T06:53:41.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25452025-02-28T06:53:41.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52050 req_id = 19e1467e-a606-45e9-ae75-4f6b9f2ca8da response_code = 204 uri = /switch-ports
25462025-02-28T06:53:41.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50764
25472025-02-28T06:53:41.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50764 req_id = 4b43c282-7a96-4589-9604-d4316cf8c3f9 response_code = 200 uri = /v2p
25482025-02-28T06:53:41.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52050 req_id = aada813d-1ba1-4562-96ef-c749429990c9 response_code = 200 uri = /network-bootstore-config
25492025-02-28T06:53:47.308ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25502025-02-28T06:53:47.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25512025-02-28T06:53:47.345ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1974, tv_nsec: 582794521 } time_to_next_cleanup = 599.99999524s
25522025-02-28T06:53:51.746ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6511 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = c180e9f3-0c46-4c95-b757-d8ad25338761 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
25532025-02-28T06:53:51.871ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64338
25542025-02-28T06:53:51.871ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64338 req_id = 4cafc56b-d00e-4c9b-9e17-ac60a54cfb72 response_code = 200 uri = /baseboard
25552025-02-28T06:54:01.891ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25562025-02-28T06:54:10.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53089
25572025-02-28T06:54:10.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53089 req_id = 74aac334-35fb-4379-b8b7-bd7eea84af16 response_code = 200 uri = /vpc-routes
25582025-02-28T06:54:10.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25592025-02-28T06:54:10.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53089 req_id = 8e345cd6-9d33-4396-b3df-364e87529cf4 response_code = 204 uri = /eip-gateways
25602025-02-28T06:54:10.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53089 req_id = 90672723-648f-4969-a873-ca332c0fa953 response_code = 204 uri = /vpc-routes
25612025-02-28T06:54:10.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34618
25622025-02-28T06:54:10.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34618 req_id = ce8188c1-875e-4450-8999-c6e6731465cc response_code = 200 uri = /v2p
25632025-02-28T06:54:10.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47374
25642025-02-28T06:54:10.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25652025-02-28T06:54:10.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25662025-02-28T06:54:10.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47374 req_id = ad5847ac-158b-4e21-925e-c24d774abeed response_code = 204 uri = /switch-ports
25672025-02-28T06:54:10.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47374 req_id = 07872f1f-de60-438d-aef7-31b67099da1b response_code = 200 uri = /network-bootstore-config
25682025-02-28T06:54:11.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47617
25692025-02-28T06:54:11.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47617 req_id = 29c2c8c1-c37b-470f-8a1f-9be79d4c1565 response_code = 200 uri = /vpc-routes
25702025-02-28T06:54:11.255ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25712025-02-28T06:54:11.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47617 req_id = 6d43fe5f-ce67-4e40-ba21-cb9399572e8f response_code = 204 uri = /eip-gateways
25722025-02-28T06:54:11.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47617 req_id = 8025c7db-51ec-4da2-9650-8e261baafbbd response_code = 204 uri = /vpc-routes
25732025-02-28T06:54:11.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47426
25742025-02-28T06:54:11.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47426 req_id = e2e913f2-a57e-415f-bb98-dfc0b6cf83cb response_code = 200 uri = /v2p
25752025-02-28T06:54:11.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45800
25762025-02-28T06:54:11.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45800 req_id = b7011fe7-4fc4-4dbe-b83c-1f2d7666d8b5 response_code = 200 uri = /vpc-routes
25772025-02-28T06:54:11.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25782025-02-28T06:54:11.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45800 req_id = d88e4466-e95c-4d3e-bd72-a2fbec352985 response_code = 204 uri = /eip-gateways
25792025-02-28T06:54:11.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45800 req_id = dc324534-79c5-492a-b610-4d3baed0fceb response_code = 204 uri = /vpc-routes
25802025-02-28T06:54:11.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55974
25812025-02-28T06:54:11.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25822025-02-28T06:54:11.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25832025-02-28T06:54:11.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55974 req_id = b15b3827-715b-4766-a0a3-b238b5211d70 response_code = 204 uri = /switch-ports
25842025-02-28T06:54:11.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60175
25852025-02-28T06:54:11.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55974 req_id = 64ef3c3c-3dac-41ba-b295-e023017ebafc response_code = 200 uri = /network-bootstore-config
25862025-02-28T06:54:11.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25872025-02-28T06:54:11.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41486
25882025-02-28T06:54:11.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41486 req_id = 35e3c3c3-82b7-486c-b15a-ac67df80bba8 response_code = 200 uri = /v2p
25892025-02-28T06:54:11.561ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25902025-02-28T06:54:11.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60175 req_id = b0ca3231-30c7-4e88-b3f3-409ac08f3518 response_code = 204 uri = /switch-ports
25912025-02-28T06:54:11.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60175 req_id = 6f3110d4-91cd-4113-b29c-759af015d253 response_code = 200 uri = /network-bootstore-config
25922025-02-28T06:54:21.748ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7423 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = eb6d97c4-678f-4650-a8a2-67ba7ee8f5f3 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
25932025-02-28T06:54:21.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34457
25942025-02-28T06:54:21.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34457 req_id = 8ca72349-8cc8-4337-878e-59b93a9e6f46 response_code = 200 uri = /baseboard
25952025-02-28T06:54:40.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62210
25962025-02-28T06:54:40.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62210 req_id = 45a3141b-4fa7-42ff-be47-c2194fad0540 response_code = 200 uri = /vpc-routes
25972025-02-28T06:54:40.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
25982025-02-28T06:54:40.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62210 req_id = b0c5932c-ef39-4ff8-9227-3b4e15d153df response_code = 204 uri = /eip-gateways
25992025-02-28T06:54:40.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49913
26002025-02-28T06:54:40.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49913 req_id = 0784450f-6c15-4f69-8676-4421d9c8e6b6 response_code = 200 uri = /v2p
26012025-02-28T06:54:40.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62210 req_id = 4fd33ee3-e8e9-4880-9e71-10a0b3d37687 response_code = 204 uri = /vpc-routes
26022025-02-28T06:54:40.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45964
26032025-02-28T06:54:40.511ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26042025-02-28T06:54:40.550ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26052025-02-28T06:54:40.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45964 req_id = b44c0b5e-ea43-4329-918c-0ad789a32e8b response_code = 204 uri = /switch-ports
26062025-02-28T06:54:40.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45964 req_id = 49b3e72b-5800-486f-9cfe-66ae1bcabb4e response_code = 200 uri = /network-bootstore-config
26072025-02-28T06:54:41.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35862
26082025-02-28T06:54:41.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35862 req_id = 9767036f-4ce2-4315-8afb-f91877b7b1d7 response_code = 200 uri = /vpc-routes
26092025-02-28T06:54:41.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26102025-02-28T06:54:41.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35862 req_id = 522c073a-0151-4bc1-8950-3d8f3965aa5d response_code = 204 uri = /eip-gateways
26112025-02-28T06:54:41.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35862 req_id = 731a6506-04c1-4d10-b55d-19923aac5c53 response_code = 204 uri = /vpc-routes
26122025-02-28T06:54:41.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58137
26132025-02-28T06:54:41.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26142025-02-28T06:54:41.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26152025-02-28T06:54:41.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58137 req_id = 23f9ffd0-9c6f-4dda-9cba-3feb5e85fb8d response_code = 204 uri = /switch-ports
26162025-02-28T06:54:41.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61761
26172025-02-28T06:54:41.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61761 req_id = 3b5c3ee2-8c30-4810-9f25-cc32c49e928d response_code = 200 uri = /v2p
26182025-02-28T06:54:41.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58137 req_id = 9394cd0b-8922-4d8d-8070-217606f8aa2f response_code = 200 uri = /network-bootstore-config
26192025-02-28T06:54:41.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44984
26202025-02-28T06:54:41.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44984 req_id = 21ebc499-85fd-4338-a9a6-328df379f63f response_code = 200 uri = /vpc-routes
26212025-02-28T06:54:41.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26222025-02-28T06:54:41.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44984 req_id = 4d67770e-ac3c-46af-9f46-bec255e35c4b response_code = 204 uri = /eip-gateways
26232025-02-28T06:54:41.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52517
26242025-02-28T06:54:41.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26252025-02-28T06:54:41.402ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26262025-02-28T06:54:41.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52517 req_id = e9170691-180e-4200-9c3c-4717da43104d response_code = 204 uri = /switch-ports
26272025-02-28T06:54:41.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58166
26282025-02-28T06:54:41.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58166 req_id = 644fe42f-3cd4-406e-9862-90bd15a35727 response_code = 200 uri = /v2p
26292025-02-28T06:54:41.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52517 req_id = db30d79c-960c-4657-aa5a-ee56a65cd914 response_code = 200 uri = /network-bootstore-config
26302025-02-28T06:54:41.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44984 req_id = 51df22fc-3d4f-4cca-b569-47eefa4209dc response_code = 204 uri = /vpc-routes
26312025-02-28T06:54:51.748ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7360 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 3b7e234a-9d5f-4a22-9a74-c33b3b601e4e response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
26322025-02-28T06:54:51.936ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43627
26332025-02-28T06:54:51.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43627 req_id = 1100ce64-cf2a-420f-ba9f-20e7b622c1e4 response_code = 200 uri = /baseboard
26342025-02-28T06:55:10.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49930
26352025-02-28T06:55:10.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49930 req_id = 4c12c1aa-f97b-4948-b264-8e3af5039bae response_code = 200 uri = /vpc-routes
26362025-02-28T06:55:10.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26372025-02-28T06:55:10.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49930 req_id = c38a4c6a-f053-4557-87fa-ca172c3fed75 response_code = 204 uri = /eip-gateways
26382025-02-28T06:55:10.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49930 req_id = efa522f8-4672-46d8-b560-2bfbaf27754f response_code = 204 uri = /vpc-routes
26392025-02-28T06:55:10.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54757
26402025-02-28T06:55:10.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54757 req_id = 02c6b73c-48b8-429e-b5aa-6016a84c9ace response_code = 200 uri = /v2p
26412025-02-28T06:55:10.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46111
26422025-02-28T06:55:10.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26432025-02-28T06:55:10.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26442025-02-28T06:55:10.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46111 req_id = 5c0f3e1f-8783-494a-a445-8c90646a8ae4 response_code = 204 uri = /switch-ports
26452025-02-28T06:55:10.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46111 req_id = 4ffe7bb4-96f8-4593-b111-d0e980d954e5 response_code = 200 uri = /network-bootstore-config
26462025-02-28T06:55:11.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43201
26472025-02-28T06:55:11.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43201 req_id = b19e21a7-e36c-4f66-b252-19eeff587393 response_code = 200 uri = /vpc-routes
26482025-02-28T06:55:11.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43110
26492025-02-28T06:55:11.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43110 req_id = 612501b6-3c43-4944-abd8-e4488b37a540 response_code = 200 uri = /v2p
26502025-02-28T06:55:11.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26512025-02-28T06:55:11.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43201 req_id = 3cbe4dfe-e3ff-4248-bf34-54e1b1823a52 response_code = 204 uri = /eip-gateways
26522025-02-28T06:55:11.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43201 req_id = 959626a0-00a5-40b3-9661-5cfa65437557 response_code = 204 uri = /vpc-routes
26532025-02-28T06:55:11.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54888
26542025-02-28T06:55:11.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26552025-02-28T06:55:11.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26562025-02-28T06:55:11.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54888 req_id = 6d0e9aad-63d1-4a94-bf4d-0e14da8d08bd response_code = 204 uri = /switch-ports
26572025-02-28T06:55:11.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49233
26582025-02-28T06:55:11.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49233 req_id = 5a40e818-b76b-4642-92ce-6f601262ce4b response_code = 200 uri = /vpc-routes
26592025-02-28T06:55:11.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54888 req_id = 27e1ec73-0fbe-4a63-84d6-a24d1936eec7 response_code = 200 uri = /network-bootstore-config
26602025-02-28T06:55:11.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59796
26612025-02-28T06:55:11.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59796 req_id = a794c89e-9d86-4b96-aa17-ddc3c276cf02 response_code = 200 uri = /v2p
26622025-02-28T06:55:11.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26632025-02-28T06:55:11.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49233 req_id = 14c12dfc-f4f1-4381-a6dd-ac98d8259fcd response_code = 204 uri = /eip-gateways
26642025-02-28T06:55:11.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49233 req_id = 5588680f-7cb0-4461-b238-249ac9312e81 response_code = 204 uri = /vpc-routes
26652025-02-28T06:55:11.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37165
26662025-02-28T06:55:11.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26672025-02-28T06:55:11.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26682025-02-28T06:55:11.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37165 req_id = 31ed2ddc-8beb-4a4d-a783-163766dc86b1 response_code = 204 uri = /switch-ports
26692025-02-28T06:55:11.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37165 req_id = cff99f29-a063-47f7-9ad6-cb7ffe6b987b response_code = 200 uri = /network-bootstore-config
26702025-02-28T06:55:21.749ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7163 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 4a5d140e-eecb-4fce-8a48-fb916abdd2b6 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
26712025-02-28T06:55:21.970ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60570
26722025-02-28T06:55:21.970ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60570 req_id = 5a58f8bf-d2a6-4a49-b604-e0c025f49368 response_code = 200 uri = /baseboard
26732025-02-28T06:55:40.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51394
26742025-02-28T06:55:40.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51394 req_id = 41e8f492-c8f1-48eb-ace1-73d2f4567518 response_code = 200 uri = /v2p
26752025-02-28T06:55:40.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49313
26762025-02-28T06:55:40.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49313 req_id = 134b4b32-28fb-4333-9612-cd7dc9f15b67 response_code = 200 uri = /vpc-routes
26772025-02-28T06:55:40.422ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26782025-02-28T06:55:40.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49313 req_id = 9d30644c-415f-4ea6-bdff-a26502eafc40 response_code = 204 uri = /eip-gateways
26792025-02-28T06:55:40.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49313 req_id = 421d94b1-5601-446b-848d-21f04b164bfa response_code = 204 uri = /vpc-routes
26802025-02-28T06:55:40.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64361
26812025-02-28T06:55:40.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26822025-02-28T06:55:40.521ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26832025-02-28T06:55:40.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64361 req_id = d21890a3-b37c-4528-92b6-04265cd3bb55 response_code = 204 uri = /switch-ports
26842025-02-28T06:55:40.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64361 req_id = 2863a10e-06a3-4945-9258-0179374bb58d response_code = 200 uri = /network-bootstore-config
26852025-02-28T06:55:41.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52579
26862025-02-28T06:55:41.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52579 req_id = 5f036ce7-48ee-4bb6-938d-1c418565a824 response_code = 200 uri = /vpc-routes
26872025-02-28T06:55:41.057ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
26882025-02-28T06:55:41.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52579 req_id = 2f35b455-0363-42b4-9b86-fdbd8e3c87a7 response_code = 204 uri = /eip-gateways
26892025-02-28T06:55:41.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52579 req_id = a5dd7784-6cba-4183-bb2d-4ccce61f1407 response_code = 204 uri = /vpc-routes
26902025-02-28T06:55:41.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40516
26912025-02-28T06:55:41.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26922025-02-28T06:55:41.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26932025-02-28T06:55:41.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40516 req_id = 48f92b7e-18e5-4f65-8346-f2afc0ea6a07 response_code = 204 uri = /switch-ports
26942025-02-28T06:55:41.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37433
26952025-02-28T06:55:41.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37433 req_id = 4c3789c2-aafc-4019-8682-9ab9a2c28620 response_code = 200 uri = /v2p
26962025-02-28T06:55:41.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40516 req_id = 3262a935-56eb-47a6-aa84-15e96ff4df50 response_code = 200 uri = /network-bootstore-config
26972025-02-28T06:55:41.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36393
26982025-02-28T06:55:41.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36393 req_id = 070e87ad-9552-4b8a-a985-ff74aa0cdff3 response_code = 200 uri = /vpc-routes
26992025-02-28T06:55:41.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
27002025-02-28T06:55:41.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36393 req_id = e85f8f34-2e59-49ec-af0e-7ed81d613eb0 response_code = 204 uri = /eip-gateways
27012025-02-28T06:55:41.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52481
27022025-02-28T06:55:41.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52481 req_id = a80528c9-e01c-46b7-9da0-a889d63756c3 response_code = 200 uri = /v2p
27032025-02-28T06:55:41.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52772
27042025-02-28T06:55:41.463ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27052025-02-28T06:55:41.504ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27062025-02-28T06:55:41.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52772 req_id = c90890e6-1b52-4501-83e7-57cbd44f8c3d response_code = 204 uri = /switch-ports
27072025-02-28T06:55:41.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36393 req_id = 2221e50b-9d54-48cf-a9ef-06712d0ed327 response_code = 204 uri = /vpc-routes
27082025-02-28T06:55:41.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52772 req_id = fc946198-c912-476e-8a84-026e66fa7ffb response_code = 200 uri = /network-bootstore-config
27092025-02-28T06:55:51.749ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7394 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = c13e3d10-c7f9-4c6c-90c3-fb5acc745720 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
27102025-02-28T06:55:52.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33462
27112025-02-28T06:55:52.003ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33462 req_id = 103a29d7-46b0-4a4d-8efb-a15b3806a63c response_code = 200 uri = /baseboard
27122025-02-28T06:56:10.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38833
27132025-02-28T06:56:10.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27142025-02-28T06:56:10.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 503 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38833 req_id = b56e988c-f882-4ee1-a282-262e1fa47bf3 response_code = 200 uri = /artifacts
27152025-02-28T06:56:10.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58562
27162025-02-28T06:56:10.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58562 req_id = d6e1bd6f-a19e-474b-96d6-5b75d359be5d response_code = 200 uri = /vpc-routes
27172025-02-28T06:56:10.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37445
27182025-02-28T06:56:10.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27192025-02-28T06:56:10.473ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27202025-02-28T06:56:10.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
27212025-02-28T06:56:10.473ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
27222025-02-28T06:56:10.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27232025-02-28T06:56:10.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a
27242025-02-28T06:56:10.529ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27252025-02-28T06:56:10.529ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff
27262025-02-28T06:56:10.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
27272025-02-28T06:56:10.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 865 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58562 req_id = 27e09234-0a4f-4c4a-9100-ff8257e89a09 response_code = 204 uri = /eip-gateways
27282025-02-28T06:56:10.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 830 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58562 req_id = c1e3163b-fd67-46c3-86b1-f8696fbdcc6c response_code = 204 uri = /vpc-routes
27292025-02-28T06:56:10.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302025-02-28T06:56:10.558ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031
27312025-02-28T06:56:10.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27322025-02-28T06:56:10.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3430e022-7133-4293-ac77-634fd73d7c3b
27332025-02-28T06:56:10.610ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27342025-02-28T06:56:10.610ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36abc0e0-9d49-4738-89cf-f6343849532d
27352025-02-28T06:56:10.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61005
27362025-02-28T06:56:10.636ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27372025-02-28T06:56:10.636ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c
27382025-02-28T06:56:10.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61005 req_id = f74c1d09-3899-4e7d-b62f-f73274542011 response_code = 200 uri = /v2p
27392025-02-28T06:56:10.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55919
27402025-02-28T06:56:10.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27412025-02-28T06:56:10.661ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422025-02-28T06:56:10.661ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a
27432025-02-28T06:56:10.685ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27442025-02-28T06:56:10.685ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4
27452025-02-28T06:56:10.692ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27462025-02-28T06:56:10.714ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27472025-02-28T06:56:10.714ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_574faf87-fd2d-44c5-bef4-135771b1853a
27482025-02-28T06:56:10.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37445 req_id = dd60c589-668b-4463-ba33-3c6044153dad response_code = 200 uri = /inventory
27492025-02-28T06:56:10.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36265
27502025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27512025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27532025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27542025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27552025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27562025-02-28T06:56:10.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27572025-02-28T06:56:10.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36265 req_id = 9eb3271b-bb4e-4e26-8811-e028c00a311b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27582025-02-28T06:56:10.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55919 req_id = 21f8f99c-c316-44dd-a281-0081ae04f9fd response_code = 204 uri = /switch-ports
27592025-02-28T06:56:10.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55919 req_id = b37ee5d8-9d8e-4df5-9d10-9e090f080c71 response_code = 200 uri = /network-bootstore-config
27602025-02-28T06:56:11.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48114
27612025-02-28T06:56:11.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48114 req_id = 08d7a5e1-87a7-4b97-9ec4-630b8b5f576c response_code = 200 uri = /vpc-routes
27622025-02-28T06:56:11.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
27632025-02-28T06:56:11.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48114 req_id = b7a644cb-5294-4c35-9c4b-10951858c5e3 response_code = 204 uri = /eip-gateways
27642025-02-28T06:56:11.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48114 req_id = 1a90a083-d107-4723-9f51-d61ce3129290 response_code = 204 uri = /vpc-routes
27652025-02-28T06:56:11.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37877
27662025-02-28T06:56:11.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37877 req_id = ca4758c6-df31-4527-8594-5e66c84b3c61 response_code = 200 uri = /v2p
27672025-02-28T06:56:11.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50261
27682025-02-28T06:56:11.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27692025-02-28T06:56:11.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50261 req_id = f8292922-7a02-4115-9726-030bfe1db32d response_code = 200 uri = /artifacts
27702025-02-28T06:56:11.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36621
27712025-02-28T06:56:11.384ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27722025-02-28T06:56:11.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27732025-02-28T06:56:11.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36621 req_id = 6e9f11ce-7c44-4f5a-bbdd-e7d9ebffd4f7 response_code = 204 uri = /switch-ports
27742025-02-28T06:56:11.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56690
27752025-02-28T06:56:11.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54923
27762025-02-28T06:56:11.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27772025-02-28T06:56:11.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27782025-02-28T06:56:11.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36621 req_id = 4894c034-78ca-4ab6-a785-534cd388e338 response_code = 200 uri = /network-bootstore-config
27792025-02-28T06:56:11.525ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27802025-02-28T06:56:11.525ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
27812025-02-28T06:56:11.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 485 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54923 req_id = beca0e08-f3cc-4e1e-9d7b-c02692c5e414 response_code = 200 uri = /artifacts
27822025-02-28T06:56:11.526ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
27832025-02-28T06:56:11.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27842025-02-28T06:56:11.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a
27852025-02-28T06:56:11.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27862025-02-28T06:56:11.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff
27872025-02-28T06:56:11.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45190
27882025-02-28T06:56:11.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45190 req_id = 168f5382-a542-4ea5-a56f-f2e4c2da5be7 response_code = 200 uri = /vpc-routes
27892025-02-28T06:56:11.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43357
27902025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27912025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27922025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27932025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27952025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27962025-02-28T06:56:11.585ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27972025-02-28T06:56:11.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43357 req_id = 220cb46c-0478-4773-8088-7bce4565e816 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27982025-02-28T06:56:11.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27992025-02-28T06:56:11.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031
28002025-02-28T06:56:11.612ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28012025-02-28T06:56:11.612ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3430e022-7133-4293-ac77-634fd73d7c3b
28022025-02-28T06:56:11.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38675
28032025-02-28T06:56:11.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28042025-02-28T06:56:11.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28052025-02-28T06:56:11.625ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/config/omicron-zones.json file = common/src/ledger.rs:177
28062025-02-28T06:56:11.630ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/config/omicron-zones.json file = common/src/ledger.rs:177
28072025-02-28T06:56:11.641ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28082025-02-28T06:56:11.641ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36abc0e0-9d49-4738-89cf-f6343849532d
28092025-02-28T06:56:11.655ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa5ce45e-0f91-4207-90f9-7f11065f9b6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28102025-02-28T06:56:11.655ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa5ce45e-0f91-4207-90f9-7f11065f9b6a
28112025-02-28T06:56:11.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58686
28122025-02-28T06:56:11.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28132025-02-28T06:56:11.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
28142025-02-28T06:56:11.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5082 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45190 req_id = 3f3aae5a-f690-4379-b5db-d80b82127fcf response_code = 204 uri = /eip-gateways
28152025-02-28T06:56:11.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77adf4a6-2e0d-4b65-8f85-5c54a39764ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28162025-02-28T06:56:11.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77adf4a6-2e0d-4b65-8f85-5c54a39764ff
28172025-02-28T06:56:11.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4000 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45190 req_id = 160fe687-f527-4c20-bd53-531376412b3a response_code = 204 uri = /vpc-routes
28182025-02-28T06:56:11.696ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28192025-02-28T06:56:11.696ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c
28202025-02-28T06:56:11.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28212025-02-28T06:56:11.719ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3bf7fa2b-342f-487b-84ab-b8eb8558a031 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28222025-02-28T06:56:11.719ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3bf7fa2b-342f-487b-84ab-b8eb8558a031
28232025-02-28T06:56:11.736ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28242025-02-28T06:56:11.736ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a
28252025-02-28T06:56:11.762ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-02-28T06:56:11.762ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4
28272025-02-28T06:56:11.777ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3430e022-7133-4293-ac77-634fd73d7c3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28282025-02-28T06:56:11.777ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3430e022-7133-4293-ac77-634fd73d7c3b
28292025-02-28T06:56:11.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58686 req_id = 31f9483c-2162-472f-92a5-7bcf9d17c5f2 response_code = 204 uri = /switch-ports
28302025-02-28T06:56:11.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58686 req_id = 94f4b26f-5a67-4d5f-a69f-567c3562f5e3 response_code = 200 uri = /network-bootstore-config
28312025-02-28T06:56:11.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28322025-02-28T06:56:11.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_574faf87-fd2d-44c5-bef4-135771b1853a
28332025-02-28T06:56:11.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284821 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56690 req_id = 94e0faea-f23c-4719-aacd-f8da020e2606 response_code = 200 uri = /inventory
28342025-02-28T06:56:11.812ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 36abc0e0-9d49-4738-89cf-f6343849532d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28352025-02-28T06:56:11.812ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_36abc0e0-9d49-4738-89cf-f6343849532d
28362025-02-28T06:56:11.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50795
28372025-02-28T06:56:11.816ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ae3f0655-38e1-4811-9df0-ec7097380fc7, kind: Service { id: 60dda83b-119e-4091-89bb-47146b9a4e21 }, name: Name("external-dns-60dda83b-119e-4091-89bb-47146b9a4e21"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 203])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ba88220d-3e44-4fee-90a0-7cb9340c4bc8, kind: Service { id: e8bdae5e-9ded-49bc-b5c4-c0a139701547 }, name: Name("external-dns-e8bdae5e-9ded-49bc-b5c4-c0a139701547"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1b9e5f70-de5b-4857-ac4f-b35f0afc0338, kind: Service { id: 6d7f93d5-671d-4f52-9b87-78d19291764d }, name: Name("nexus-6d7f93d5-671d-4f52-9b87-78d19291764d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 550c9ef2-8cad-419e-bf8c-88006e68d87d, kind: Service { id: 6dfa79a4-7e7e-4b2a-844c-45801a599ee9 }, name: Name("nexus-6dfa79a4-7e7e-4b2a-844c-45801a599ee9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9cb5358e-71a9-4d99-9d53-d6d8ec044d4e, kind: Service { id: d6c49f97-8f2b-4a10-a742-f63fd5970a6c }, name: Name("nexus-d6c49f97-8f2b-4a10-a742-f63fd5970a6c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28382025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28392025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28402025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28412025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28422025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28432025-02-28T06:56:11.817ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28442025-02-28T06:56:11.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 645 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50795 req_id = ea6ae005-7017-429e-9b98-49969d19ba19 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28452025-02-28T06:56:11.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34379
28462025-02-28T06:56:11.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34379 req_id = e92e5fef-4942-4e95-8f01-df07df34e559 response_code = 200 uri = /v2p
28472025-02-28T06:56:11.835ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d796acf1-b12c-4ae9-a449-e819e652dd0c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28482025-02-28T06:56:11.835ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d796acf1-b12c-4ae9-a449-e819e652dd0c
28492025-02-28T06:56:11.857ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b0f1596a-e4f9-4ff9-83cd-0888039ed42a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28502025-02-28T06:56:11.857ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b0f1596a-e4f9-4ff9-83cd-0888039ed42a
28512025-02-28T06:56:11.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d561fffc-9174-47c9-b549-14ba5ae1eef4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28522025-02-28T06:56:11.877ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d561fffc-9174-47c9-b549-14ba5ae1eef4
28532025-02-28T06:56:11.898ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 574faf87-fd2d-44c5-bef4-135771b1853a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28542025-02-28T06:56:11.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_574faf87-fd2d-44c5-bef4-135771b1853a
28552025-02-28T06:56:11.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287009 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38675 req_id = 7995ad6f-e302-4b19-a947-7eaf00c0da78 response_code = 200 uri = /inventory
28562025-02-28T06:56:21.752ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9271 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 6ac12afa-003c-4002-85b3-9df371dc334c response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
28572025-02-28T06:56:22.037ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59671
28582025-02-28T06:56:22.037ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59671 req_id = bee15346-ac04-4caf-9001-a2961994271d response_code = 200 uri = /baseboard
28592025-02-28T06:56:40.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59716
28602025-02-28T06:56:40.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59716 req_id = 9dad9001-a28f-4faa-b1f2-d0f1924f921c response_code = 200 uri = /vpc-routes
28612025-02-28T06:56:40.406ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
28622025-02-28T06:56:40.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59716 req_id = 11b1b589-f4ff-488b-a7ba-02c846740417 response_code = 204 uri = /eip-gateways
28632025-02-28T06:56:40.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48751
28642025-02-28T06:56:40.411ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28652025-02-28T06:56:40.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28662025-02-28T06:56:40.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48751 req_id = 4a77cd0b-216f-4e30-acf3-a5ada7c4a728 response_code = 204 uri = /switch-ports
28672025-02-28T06:56:40.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52109
28682025-02-28T06:56:40.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52109 req_id = b5e9ebef-ff46-4e88-bb81-f58bee3d2ad9 response_code = 200 uri = /v2p
28692025-02-28T06:56:40.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48751 req_id = 1184e4de-d4a4-4919-ac70-8f95033f7731 response_code = 200 uri = /network-bootstore-config
28702025-02-28T06:56:40.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59716 req_id = 28aca2a9-1499-4946-aedd-bbd7c6da4290 response_code = 204 uri = /vpc-routes
28712025-02-28T06:56:40.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59788
28722025-02-28T06:56:40.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59788 req_id = 9832a0ac-43ca-4f4f-a548-95631558b348 response_code = 200 uri = /vpc-routes
28732025-02-28T06:56:41.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
28742025-02-28T06:56:41.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59788 req_id = c14d9321-1d96-4de7-b581-990bfa4a1159 response_code = 204 uri = /eip-gateways
28752025-02-28T06:56:41.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46467
28762025-02-28T06:56:41.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46467 req_id = 45f11bb7-21d6-4afa-829f-c78d89847ebf response_code = 200 uri = /v2p
28772025-02-28T06:56:41.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59788 req_id = 0896f52a-401e-4ee2-842e-ee3da70e7a3f response_code = 204 uri = /vpc-routes
28782025-02-28T06:56:41.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38016
28792025-02-28T06:56:41.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28802025-02-28T06:56:41.113ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28812025-02-28T06:56:41.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38016 req_id = 3ed13b58-801c-4a27-bcff-8b01d595127b response_code = 204 uri = /switch-ports
28822025-02-28T06:56:41.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38016 req_id = 2d811d52-cf0a-46df-88a6-3a7365472533 response_code = 200 uri = /network-bootstore-config
28832025-02-28T06:56:41.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62354
28842025-02-28T06:56:41.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62354 req_id = 6f6a44d2-4f18-4453-99dc-82a8df37b72d response_code = 200 uri = /vpc-routes
28852025-02-28T06:56:41.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
28862025-02-28T06:56:41.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62354 req_id = f2bed1ec-f9f6-4636-912b-81b3d5c77109 response_code = 204 uri = /eip-gateways
28872025-02-28T06:56:41.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62545
28882025-02-28T06:56:41.405ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28892025-02-28T06:56:41.444ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28902025-02-28T06:56:41.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62545 req_id = 54e0571c-1d1f-483c-94c5-9ed58cfbc16d response_code = 204 uri = /switch-ports
28912025-02-28T06:56:41.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47584
28922025-02-28T06:56:41.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62545 req_id = 26218e2b-0b36-41d6-a416-c11255342332 response_code = 200 uri = /network-bootstore-config
28932025-02-28T06:56:41.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62354 req_id = 5cf1dac2-ea7f-4241-801b-85b5c40fcafa response_code = 204 uri = /vpc-routes
28942025-02-28T06:56:41.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47584 req_id = e7ac3db8-27a5-4900-b22c-f4f1a8512ae4 response_code = 200 uri = /v2p
28952025-02-28T06:56:51.750ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7397 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = ca9821f3-f6fc-482f-ba1a-531bc5619614 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
28962025-02-28T06:56:52.070ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59090
28972025-02-28T06:56:52.071ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59090 req_id = 76554720-bcda-45b8-9be5-484e405f458d response_code = 200 uri = /baseboard
28982025-02-28T06:57:10.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53141
28992025-02-28T06:57:10.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53141 req_id = a21c1ace-bae5-48f9-9ea5-caf11ddf6db6 response_code = 200 uri = /vpc-routes
29002025-02-28T06:57:10.415ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
29012025-02-28T06:57:10.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53141 req_id = d03240f2-4d08-49a9-87c9-d759f13667bc response_code = 204 uri = /eip-gateways
29022025-02-28T06:57:10.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53141 req_id = cd111c01-137c-49e8-9b74-505a60440d40 response_code = 204 uri = /vpc-routes
29032025-02-28T06:57:10.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36497
29042025-02-28T06:57:10.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36497 req_id = 6f056a67-5288-4f8a-9500-4b084f8a7d62 response_code = 200 uri = /v2p
29052025-02-28T06:57:10.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44295
29062025-02-28T06:57:10.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29072025-02-28T06:57:10.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29082025-02-28T06:57:10.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44295 req_id = 9c67d22e-519c-4fdc-a35c-d6299b31f40f response_code = 204 uri = /switch-ports
29092025-02-28T06:57:10.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44295 req_id = 0e0d5d58-50e3-4002-9042-76959b3ceb28 response_code = 200 uri = /network-bootstore-config
29102025-02-28T06:57:11.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53472
29112025-02-28T06:57:11.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53472 req_id = 024ae2fc-c3c4-4226-950c-43957731b2f1 response_code = 200 uri = /vpc-routes
29122025-02-28T06:57:11.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
29132025-02-28T06:57:11.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53472 req_id = c60d8684-5206-43e2-9057-c6dda02839c8 response_code = 204 uri = /eip-gateways
29142025-02-28T06:57:11.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53472 req_id = 51118452-0a7e-4ff3-8130-29fdf7f397eb response_code = 204 uri = /vpc-routes
29152025-02-28T06:57:11.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43838
29162025-02-28T06:57:11.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43838 req_id = 48f1a0f1-f2ae-4751-9d1b-ca98f945d341 response_code = 200 uri = /v2p
29172025-02-28T06:57:11.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46198
29182025-02-28T06:57:11.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29192025-02-28T06:57:11.431ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29202025-02-28T06:57:11.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46198 req_id = 903d6298-7af8-4b0c-ac77-a3bd55edbc4a response_code = 204 uri = /switch-ports
29212025-02-28T06:57:11.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57172
29222025-02-28T06:57:11.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57172 req_id = 0c79ab33-726b-4e0a-a6d0-b15ed362d48e response_code = 200 uri = /vpc-routes
29232025-02-28T06:57:11.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46198 req_id = 31638831-9d9e-4b0a-ae5d-e62cbbfcdfde response_code = 200 uri = /network-bootstore-config
29242025-02-28T06:57:11.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61516
29252025-02-28T06:57:11.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61516 req_id = ef3e2393-f98b-488b-a0ad-223822088787 response_code = 200 uri = /v2p
29262025-02-28T06:57:11.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58519
29272025-02-28T06:57:11.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29282025-02-28T06:57:11.666ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29292025-02-28T06:57:11.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58519 req_id = 5ca595b4-71c2-4c35-b93d-0c9dcb43e26b response_code = 204 uri = /switch-ports
29302025-02-28T06:57:11.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
29312025-02-28T06:57:11.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57172 req_id = a085bc22-2a7a-46a5-8b71-9a5eebbfbb85 response_code = 204 uri = /eip-gateways
29322025-02-28T06:57:11.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58519 req_id = bfc5806b-65d5-4ac0-8399-210e70e40723 response_code = 200 uri = /network-bootstore-config
29332025-02-28T06:57:11.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57172 req_id = e5fbd7aa-13da-4ae6-b6b9-f6a1cd630f94 response_code = 204 uri = /vpc-routes
29342025-02-28T06:57:21.751ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7191 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 05ceab94-daf7-4c86-8a18-8cd1084398ae response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
29352025-02-28T06:57:22.104ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51189
29362025-02-28T06:57:22.104ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51189 req_id = bba0ad4b-b190-43f4-8ce1-7ffab3b38724 response_code = 200 uri = /baseboard
29372025-02-28T06:57:33.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34725
29382025-02-28T06:57:33.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34725 req_id = af168bd0-e2a4-4cc5-a317-7f34328b723f response_code = 200 uri = /v2p
29392025-02-28T06:57:33.525ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6733568) }
29402025-02-28T06:57:33.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34725 req_id = 9f43e37d-d7d3-47c8-8ff4-f2a009a2b79d response_code = 204 uri = /v2p
29412025-02-28T06:57:33.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48027
29422025-02-28T06:57:33.833ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6733568))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ba806215-d6b1-4d56-86ad-6ffc62a7ff29, slot: 0, read_only: false, vcr_json: .., name: "disk-7e19bc94c4c" }], boot_settings: Some(InstanceBootSettings { order: [ba806215-d6b1-4d56-86ad-6ffc62a7ff29] }), cloud_init_bytes: Some(..) } instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf metadata = InstanceMetadata { silo_id: 180b214e-2add-49ed-bc8e-3c27207b4df3, project_id: 19f92e3e-a3d4-4b06-855d-d8a5cca5ac50 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T06:57:33.804325541Z }
29432025-02-28T06:57:33.833ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf migration_id = None propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29442025-02-28T06:57:33.834ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf migration_id = None propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6733568))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8c8cfa25-475f-4b60-8d04-da862a94eb3c, kind: Instance { id: cbaa42c3-211e-4c37-a55a-798d2cb552bf }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6733568), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ba806215-d6b1-4d56-86ad-6ffc62a7ff29, slot: 0, read_only: false, vcr_json: .., name: "disk-7e19bc94c4c" }], boot_settings: Some(InstanceBootSettings { order: [ba806215-d6b1-4d56-86ad-6ffc62a7ff29] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T06:57:33.804325541Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29452025-02-28T06:57:33.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35091 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48027 req_id = 4cb9f60c-0eda-4ecc-a461-f26288cf0f4b response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2
29462025-02-28T06:57:33.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40075
29472025-02-28T06:57:33.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 897 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40075 req_id = f942e835-7206-4f87-abd1-118bc9cfb539 response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2/state
29482025-02-28T06:57:33.942ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6733568 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29492025-02-28T06:57:33.942ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29502025-02-28T06:57:33.982ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2 file = illumos-utils/src/zone.rs:325 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29512025-02-28T06:57:34.005ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2 file = illumos-utils/src/zone.rs:363 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29522025-02-28T06:57:34.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32895
29532025-02-28T06:57:34.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32895 req_id = c97df390-1354-494b-a7be-70d851d40a49 response_code = 200 uri = /vpc-routes
29542025-02-28T06:57:34.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {8c8cfa25-475f-4b60-8d04-da862a94eb3c: {10.151.1.175: {45691d2e-05af-4993-8248-177412843c95}, 10.151.1.176: {45691d2e-05af-4993-8248-177412843c95}}} }
29552025-02-28T06:57:35.676ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29562025-02-28T06:57:35.676ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2 zone file = illumos-utils/src/running_zone.rs:489 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29572025-02-28T06:57:35.877ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 64.734832ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29582025-02-28T06:57:35.972ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 53.797749ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29592025-02-28T06:57:36.043ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 280.465036ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29602025-02-28T06:57:36.345ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 356.528786ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29612025-02-28T06:57:36.718ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 893.556406ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29622025-02-28T06:57:37.625ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 1.36997293s file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29632025-02-28T06:57:39.006ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 1.079601778s file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29642025-02-28T06:57:40.096ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 1.000414146s file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 zone = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
29652025-02-28T06:57:40.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40992
29662025-02-28T06:57:40.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50996
29672025-02-28T06:57:40.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29682025-02-28T06:57:40.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29692025-02-28T06:57:40.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50996 req_id = 42792b36-63b0-421c-8eb6-218012abbe4c response_code = 204 uri = /switch-ports
29702025-02-28T06:57:40.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38150
29712025-02-28T06:57:40.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34932
29722025-02-28T06:57:40.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34932 req_id = 2d351cb7-f0ac-4c6e-a6c2-dc4c3d372abb response_code = 200 uri = /v2p
29732025-02-28T06:57:40.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38150 req_id = df5ea197-c289-48d3-8d9e-cb587153552c response_code = 200 uri = /vpc-routes
29742025-02-28T06:57:40.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50996 req_id = f0b1e38f-e330-4533-ad8e-ebf1eca0f747 response_code = 200 uri = /network-bootstore-config
29752025-02-28T06:57:40.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {8c8cfa25-475f-4b60-8d04-da862a94eb3c: {10.151.1.175: {45691d2e-05af-4993-8248-177412843c95}, 10.151.1.176: {45691d2e-05af-4993-8248-177412843c95}}} }
29762025-02-28T06:57:40.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38150 req_id = a9839865-851d-4abe-a27e-8434e351c0f6 response_code = 204 uri = /eip-gateways
29772025-02-28T06:57:40.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 509 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38150 req_id = eea08ea2-8378-4696-875e-79095fd4c066 response_code = 204 uri = /vpc-routes
29782025-02-28T06:57:41.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32770
29792025-02-28T06:57:41.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53019
29802025-02-28T06:57:41.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53019 req_id = ebc26715-af3a-489e-abf5-3305cb6d6e09 response_code = 200 uri = /vpc-routes
29812025-02-28T06:57:41.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {8c8cfa25-475f-4b60-8d04-da862a94eb3c: {10.151.1.176: {45691d2e-05af-4993-8248-177412843c95}, 10.151.1.175: {45691d2e-05af-4993-8248-177412843c95}}} }
29822025-02-28T06:57:41.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53019 req_id = 7447ca07-dcd5-4e31-b6e5-0f8ffeac376d response_code = 204 uri = /eip-gateways
29832025-02-28T06:57:41.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53019 req_id = dee64adb-1a59-4f72-bf1f-8dabe6d7339a response_code = 204 uri = /vpc-routes
29842025-02-28T06:57:41.128ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2 file = sled-agent/src/instance.rs:2133 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29852025-02-28T06:57:41.138ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 59.257826ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29862025-02-28T06:57:41.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33888
29872025-02-28T06:57:41.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29882025-02-28T06:57:41.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29892025-02-28T06:57:41.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33888 req_id = 98f11330-946b-4891-abbe-26d45c944280 response_code = 204 uri = /switch-ports
29902025-02-28T06:57:41.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62594
29912025-02-28T06:57:41.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33888 req_id = 090d1003-3622-4a54-bf00-d90accc8100e response_code = 200 uri = /network-bootstore-config
29922025-02-28T06:57:41.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62594 req_id = bb80ffd0-c054-4c30-9d76-1ca48368ce8d response_code = 200 uri = /v2p
29932025-02-28T06:57:41.269ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2") failed: Property not found. retry in 122.078427ms file = illumos-utils/src/svc.rs:42 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
29942025-02-28T06:57:41.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61272
29952025-02-28T06:57:41.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55611
29962025-02-28T06:57:41.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55611 req_id = 0ad3f4ba-3e5d-426d-b1d2-fadf98ccbb39 response_code = 200 uri = /v2p
29972025-02-28T06:57:41.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33532
29982025-02-28T06:57:41.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29992025-02-28T06:57:41.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
30002025-02-28T06:57:41.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33532 req_id = 69a14fab-ff58-4081-a805-d9fe14128dc3 response_code = 204 uri = /switch-ports
30012025-02-28T06:57:41.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 845 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33532 req_id = b69cdded-0fa4-4cdd-a179-86b67eb8e91c response_code = 200 uri = /network-bootstore-config
30022025-02-28T06:57:41.472ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30032025-02-28T06:57:41.508ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30042025-02-28T06:57:41.593ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30052025-02-28T06:57:41.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 318911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61272 req_id = d283bb0c-57bc-44a4-894d-26084725f70e response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2/state
30062025-02-28T06:57:41.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 591331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32770 req_id = 17114675-c727-4cb8-9739-d7add5229097 response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2/state
30072025-02-28T06:57:41.595ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
30082025-02-28T06:57:41.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7525676 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32895 req_id = 2e16b5be-e354-4280-8fdd-031cdd3bf709 response_code = 204 uri = /eip-gateways
30092025-02-28T06:57:41.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1293726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40992 req_id = 00d2b346-3fa4-4ef8-ae3b-b0e4f857047e response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2/state
30102025-02-28T06:57:41.596ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-28T06:57:41.596590164Z } file = sled-agent/src/instance.rs:842 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30112025-02-28T06:57:41.596ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T06:57:41.596590164Z } propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30122025-02-28T06:57:41.596ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T06:57:41.596590164Z }, migration_in: None, migration_out: None }
30132025-02-28T06:57:41.628ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-28T06:57:41.628117661Z } file = sled-agent/src/instance.rs:842 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30142025-02-28T06:57:41.628ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T06:57:41.628117661Z } propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30152025-02-28T06:57:41.628ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T06:57:41.628117661Z }, migration_in: None, migration_out: None }
30162025-02-28T06:57:41.733ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 8bef6b7b-1c55-47cc-99e1-a0ded1c75196, version: 3 } old_vers = RouterVersion { router_id: 8bef6b7b-1c55-47cc-99e1-a0ded1c75196, version: 3 } subnet = RouterId { vni: Vni(6733568), kind: System }
30172025-02-28T06:57:41.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32895 req_id = 7a07e9dc-4700-4642-8b1d-87279482207b response_code = 204 uri = /vpc-routes
30182025-02-28T06:57:41.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57968
30192025-02-28T06:57:41.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57968 req_id = 3bb4b619-b023-4785-bfa3-52399f61d6a6 response_code = 200 uri = /vpc-routes
30202025-02-28T06:57:41.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {8c8cfa25-475f-4b60-8d04-da862a94eb3c: {10.151.1.175: {45691d2e-05af-4993-8248-177412843c95}, 10.151.1.176: {45691d2e-05af-4993-8248-177412843c95}}} }
30212025-02-28T06:57:41.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57968 req_id = 3a2f04b9-59b1-42ba-b4e0-b4eefe38bf63 response_code = 204 uri = /eip-gateways
30222025-02-28T06:57:41.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57968 req_id = e2252d1b-cc11-40a9-aa57-3734349565ad response_code = 204 uri = /vpc-routes
30232025-02-28T06:57:51.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32949
30242025-02-28T06:57:51.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 811 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32949 req_id = a547467f-c57f-42b4-9519-3b7e861a3c08 response_code = 200 uri = /vmms/4b47b221-db75-44e9-8e83-a82036a425e2/state
30252025-02-28T06:57:51.452ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-28T06:57:51.452890790Z } file = sled-agent/src/instance.rs:842 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30262025-02-28T06:57:51.452ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T06:57:51.452890790Z } propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30272025-02-28T06:57:51.452ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T06:57:51.452890790Z }, migration_in: None, migration_out: None }
30282025-02-28T06:57:51.465ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-28T06:57:51.465369120Z } file = sled-agent/src/instance.rs:842 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30292025-02-28T06:57:51.465ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-28T06:57:51.465369120Z } propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30302025-02-28T06:57:51.465ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30312025-02-28T06:57:51.465ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30322025-02-28T06:57:51.465ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30332025-02-28T06:57:51.466ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/7b076552-73aa-4fa4-8a89-0399e8a1ec96/debug/bundle/zone", "/pool/int/c3be6427-4bf0-4318-b160-a3ae7a69e6ac/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/fa5ce45e-0f91-4207-90f9-7f11065f9b6a/crypt/debug", "/pool/ext/77adf4a6-2e0d-4b65-8f85-5c54a39764ff/crypt/debug", "/pool/ext/3bf7fa2b-342f-487b-84ab-b8eb8558a031/crypt/debug", "/pool/ext/3430e022-7133-4293-ac77-634fd73d7c3b/crypt/debug", "/pool/ext/36abc0e0-9d49-4738-89cf-f6343849532d/crypt/debug", "/pool/ext/d796acf1-b12c-4ae9-a449-e819e652dd0c/crypt/debug", "/pool/ext/b0f1596a-e4f9-4ff9-83cd-0888039ed42a/crypt/debug", "/pool/ext/d561fffc-9174-47c9-b549-14ba5ae1eef4/crypt/debug", "/pool/ext/574faf87-fd2d-44c5-bef4-135771b1853a/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2
30342025-02-28T06:57:51.751ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7572 local_addr = [fd00:1122:3344:101::1]:42813 method = GET remote_addr = [fd00:1122:3344:101::d]:46262 req_id = 1c316719-d7cc-4d3b-a754-080e5b6d7694 response_code = 200 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 uri = /ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
30352025-02-28T06:57:52.109ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2", bundle_id: a1e85e09-683b-45ae-9b05-2938634862fb }, time_created: 2025-02-28T06:57:51.466554944Z, version: 0, cause: TerminatedInstance }
30362025-02-28T06:57:52.109ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4b47b221-db75-44e9-8e83-a82036a425e2 file = sled-agent/src/instance.rs:1376 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30372025-02-28T06:57:52.136ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49134
30382025-02-28T06:57:52.137ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49134 req_id = 2ebc345f-ad6b-47b0-bdf9-28707a28f411 response_code = 200 uri = /baseboard
30392025-02-28T06:57:53.874ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30402025-02-28T06:57:53.891ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(6733568), kind: System }
30412025-02-28T06:57:53.891ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(6733568), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30422025-02-28T06:57:53.892ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T06:57:53.892143540Z }, migration_in: None, migration_out: None }
30432025-02-28T06:57:53.924ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T06:57:53.892143540Z }, migration_in: None, migration_out: None }
30442025-02-28T06:57:53.929ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = cbaa42c3-211e-4c37-a55a-798d2cb552bf propolis_id = 4b47b221-db75-44e9-8e83-a82036a425e2
30452025-02-28T06:57:54.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41082
30462025-02-28T06:57:54.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41082 req_id = a378aeea-c23d-4513-848b-972e28ef75cb response_code = 200 uri = /vpc-routes
30472025-02-28T06:57:54.355ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {8c8cfa25-475f-4b60-8d04-da862a94eb3c: {10.151.1.176: {45691d2e-05af-4993-8248-177412843c95}, 10.151.1.175: {45691d2e-05af-4993-8248-177412843c95}}} }
30482025-02-28T06:57:54.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41082 req_id = 9d016191-b946-4be5-b6f7-f7b9de3b4f50 response_code = 204 uri = /eip-gateways
30492025-02-28T06:57:54.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41082 req_id = 873bbe75-3de5-4d14-bf95-35aecccf75f9 response_code = 204 uri = /vpc-routes
30502025-02-28T06:57:54.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47665
30512025-02-28T06:57:54.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47665 req_id = 7d652917-f642-4429-a434-adfc30f2e4f1 response_code = 200 uri = /v2p
30522025-02-28T06:57:55.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49573
30532025-02-28T06:57:55.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49573 req_id = 99aaac8a-d2d8-4482-8bef-d5d6438bd750 response_code = 200 uri = /vpc-routes
30542025-02-28T06:57:55.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
30552025-02-28T06:57:55.044ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9
30562025-02-28T06:57:55.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49573 req_id = 45675347-0aa0-41c6-9871-92cf4711baf5 response_code = 204 uri = /eip-gateways
30572025-02-28T06:57:55.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60481
30582025-02-28T06:57:55.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60481 req_id = 55c3b244-9a2d-491c-b43e-7bc689e42a7a response_code = 200 uri = /v2p
30592025-02-28T06:57:55.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49573 req_id = 91216896-2e39-4c8a-912d-d817aa297648 response_code = 204 uri = /vpc-routes
30602025-02-28T06:57:55.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36948
30612025-02-28T06:57:55.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36948 req_id = c8f95ede-8da9-4bb9-983d-aad2cec5ed82 response_code = 200 uri = /vpc-routes
30622025-02-28T06:57:55.794ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = ed9a75ac-22dc-4a6b-95d9-aa9d8b3cc6d9 values = ExternalIpGatewayMap { mappings: {} }
30632025-02-28T06:57:55.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36948 req_id = d40105bb-7d7e-41e7-8fc2-5b1659e5f889 response_code = 204 uri = /eip-gateways
30642025-02-28T06:57:55.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36948 req_id = 17d05367-00b0-4676-b7a8-bf87db655718 response_code = 204 uri = /vpc-routes