Max level shown:
1 [ Feb 28 11:04:13 Enabled. ]
2 [ Feb 28 11:04:13 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Feb 28 11:04:13 Method "start" exited with status 0. ]
4 [ Feb 28 11:04:13 Rereading configuration. ]
5 [ Feb 28 11:04:13 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-02-28T11:04:13.073ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-02-28T11:04:13.074ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:294
92025-02-28T11:04:13.126ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:301
102025-02-28T11:04:13.126ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-02-28T11:04:13.241ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-02-28T11:04:13.250ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-02-28T11:04:13.258ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:311 path = /var/run/oxide/
142025-02-28T11:04:13.862ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/pre_server.rs:105 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-02-28T11:04:14.002ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-02-28T11:04:14.002ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-02-28T11:04:14.002ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-02-28T11:04:14.002ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-02-28T11:04:14.002ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-02-28T11:04:14.002ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-02-28T11:04:14.005ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-02-28T11:04:14.005ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-02-28T11:04:14.005ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-02-28T11:04:14.005ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-02-28T11:04:14.005ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-02-28T11:04:14.005ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-02-28T11:04:14.005ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-02-28T11:04:14.005ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-02-28T11:04:14.005ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-02-28T11:04:14.018ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-02-28T11:04:14.018ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool)
322025-02-28T11:04:14.116ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal }
332025-02-28T11:04:14.477ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-02-28T11:04:14.477ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-02-28T11:04:14.477ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-02-28T11:04:14.477ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-02-28T11:04:14.477ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-02-28T11:04:14.477ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-02-28T11:04:14.477ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-02-28T11:04:14.485ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-02-28T11:04:14.485ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool)
422025-02-28T11:04:14.573ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal }
432025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
512025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-02-28T11:04:14.939ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-02-28T11:04:14.939ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-02-28T11:04:14.939ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-02-28T11:04:14.939ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-02-28T11:04:14.939ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-02-28T11:04:14.939ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-02-28T11:04:14.939ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-02-28T11:04:14.939ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-02-28T11:04:14.940ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-02-28T11:04:14.940ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-02-28T11:04:14.940ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-02-28T11:04:14.951ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:793
1132025-02-28T11:04:14.951ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1423, tv_nsec: 776190234 } time_to_next_cleanup = 599.999931159s
1142025-02-28T11:04:14.951ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
1152025-02-28T11:04:14.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-02-28T11:04:14.953ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-02-28T11:04:14.954ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-02-28T11:04:14.954ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-02-28T11:04:14.956ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-02-28T11:04:14.956ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1190
1212025-02-28T11:04:14.956ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-02-28T11:04:14.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-02-28T11:04:14.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-02-28T11:04:14.956ZINFOSledAgent (RSS): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/rss-started.marker file = common/src/ledger.rs:188
1252025-02-28T11:04:14.956ZINFOSledAgent (RSS): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/rss-started.marker file = common/src/ledger.rs:188
1262025-02-28T11:04:14.956ZINFOSledAgent (RSS): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-02-28T11:04:14.956ZINFOSledAgent (RSS): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-02-28T11:04:14.956ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1239
1292025-02-28T11:04:14.956ZINFOSledAgent (RSS): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-02-28T11:04:14.957ZINFOSledAgent (RSS): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-02-28T11:04:14.957ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1271
1322025-02-28T11:04:14.957ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-02-28T11:04:14.957ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-02-28T11:04:14.957ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1302
1352025-02-28T11:04:14.957ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-02-28T11:04:14.957ZINFOSledAgent (bootstore): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-02-28T11:04:14.957ZINFOSledAgent (bootstore): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-02-28T11:04:14.957ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-02-28T11:04:14.957ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f (sled), rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-02-28T11:04:14.958ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4353
1412025-02-28T11:04:14.958ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4759
1422025-02-28T11:04:14.962ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1432025-02-28T11:04:14.968ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1442025-02-28T11:04:14.968ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1452025-02-28T11:04:14.973ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-02-28T11:04:14.973ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-02-28T11:04:14.973ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48416
1482025-02-28T11:04:14.973ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f (sled), rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:366
1492025-02-28T11:04:14.973ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:381
1502025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1512025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1522025-02-28T11:04:14.973ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-02-28T11:04:14.973ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1582025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1592025-02-28T11:04:14.973ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1602025-02-28T11:04:14.973ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1612025-02-28T11:04:14.973ZINFOSledAgent (BootstrapAgentStartup): Sending underlay prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:422 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1622025-02-28T11:04:14.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-02-28T11:04:15.012ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-02-28T11:04:15.030ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-02-28T11:04:15.035ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1662025-02-28T11:04:15.035ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-02-28T11:04:15.035ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1682025-02-28T11:04:15.035ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1692025-02-28T11:04:15.038ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "30329cd8-35aa-4a78-9194-32b369dd7041", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "30329cd8-35aa-4a78-9194-32b369dd7041" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 63.50021ms
1702025-02-28T11:04:15.049ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-02-28T11:04:15.072ZINFOSledAgent: successfully created encrypted zvol: name="oxi_41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-02-28T11:04:15.072ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/swap" file = sled-agent/src/swap_device.rs:96
1732025-02-28T11:04:15.077ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1742025-02-28T11:04:15.077ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-02-28T11:04:15.077ZINFOSledAgent (BackingFs): Ensuring dataset oxi_41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-02-28T11:04:15.102ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1772025-02-28T11:04:15.103ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5cea09fe-f441-45d0-a0e2-31b1d0adbdec", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5cea09fe-f441-45d0-a0e2-31b1d0adbdec" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 110.736687ms
1782025-02-28T11:04:15.146ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-02-28T11:04:15.215ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1802025-02-28T11:04:15.215ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "115e6579-b315-4465-97d9-842f2305c64a", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "115e6579-b315-4465-97d9-842f2305c64a" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 99.510697ms
1812025-02-28T11:04:15.316ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1822025-02-28T11:04:15.317ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "501c9ecd-6716-4300-a20b-559f0a91303f", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "501c9ecd-6716-4300-a20b-559f0a91303f" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 133.62201ms
1832025-02-28T11:04:15.365ZINFOSledAgent (BackingFs): Mounting oxi_41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-02-28T11:04:15.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-02-28T11:04:15.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-02-28T11:04:15.377ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-02-28T11:04:15.377ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-02-28T11:04:15.451ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1892025-02-28T11:04:15.453ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f00c45e3-5b61-4156-88a1-98c45edb985d", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f00c45e3-5b61-4156-88a1-98c45edb985d" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 201.915951ms
1902025-02-28T11:04:15.656ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1912025-02-28T11:04:15.656ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ee52d46b-6fba-407b-8629-cd7620e64fad", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ee52d46b-6fba-407b-8629-cd7620e64fad" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 322.668552ms
1922025-02-28T11:04:15.980ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
1932025-02-28T11:04:15.980ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry) DdmAdminClient = [::1]:8000 error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2a5fc746-bc24-428a-bbd5-ef7ccbe5303e", "content-length": "124", "date": "Fri, 28 Feb 2025 11:04:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2a5fc746-bc24-428a-bbd5-ef7ccbe5303e" } file = sled-agent/src/bootstrap/server.rs:471 retry_after = 291.810603ms
1942025-02-28T11:04:16.115ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1952025-02-28T11:04:16.121ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:32928 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1962025-02-28T11:04:16.121ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1972025-02-28T11:04:16.121ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:32928 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1982025-02-28T11:04:16.122ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 303.77465ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
1992025-02-28T11:04:16.123ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2002025-02-28T11:04:16.123ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2012025-02-28T11:04:16.123ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:977 underlay_address = fd00:1122:3344:101::1
2022025-02-28T11:04:16.123ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-02-28T11:04:16.273ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 file = sled-agent/src/bootstrap/server.rs:463 request = EnableStatsRequest { addr: fd00:1122:3344:101::1, dns_servers: ["[fd00:1122:3344:1::1]:53", "[fd00:1122:3344:2::1]:53", "[fd00:1122:3344:3::1]:53"], rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f }
2042025-02-28T11:04:16.428ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 613.614598ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2052025-02-28T11:04:17.042ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.308510704s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2062025-02-28T11:04:18.352ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.924634612s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2072025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2787
2082025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:3015
2092025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2657
2102025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2704
2112025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3096
2122025-02-28T11:04:19.162ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3141
2132025-02-28T11:04:19.164ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2923
2142025-02-28T11:04:19.165ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2698
2152025-02-28T11:04:19.166ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='88eaca09-3621-4c0a-8989-ec35807dd6c9'/> <propval type="astring" name="rack_id" value='3639df61-b683-4f88-93e4-a3de5b0778af'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea5:c17'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='3639df61-b683-4f88-93e4-a3de5b0778af'/> <propval type="astring" name="sled_id" value='586e5b1c-fe84-4966-a99c-108aa56b2c5f'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='3639df61-b683-4f88-93e4-a3de5b0778af'/> <propval type="astring" name="sled_id" value='586e5b1c-fe84-4966-a99c-108aa56b2c5f'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='586e5b1c-fe84-4966-a99c-108aa56b2c5f'/> <propval type="astring" name="rack_uuid" value='3639df61-b683-4f88-93e4-a3de5b0778af'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='586e5b1c-fe84-4966-a99c-108aa56b2c5f'/> <propval type="astring" name="rack_uuid" value='3639df61-b683-4f88-93e4-a3de5b0778af'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-02-28T11:04:19.166ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_switch
2172025-02-28T11:04:19.458ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 58.530777ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-02-28T11:04:19.655ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 132.866044ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-02-28T11:04:19.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 280.057655ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-02-28T11:04:20.222ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 214.355916ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-02-28T11:04:20.279ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.217625164s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2222025-02-28T11:04:20.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 424.352652ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-02-28T11:04:21.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.462450539s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-02-28T11:04:22.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 575.955501ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-02-28T11:04:23.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.304054338s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-02-28T11:04:24.498ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.801255904s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2272025-02-28T11:04:25.199ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-02-28T11:04:25.199ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2292025-02-28T11:04:25.200ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-02-28T11:04:25.200ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:495
2312025-02-28T11:04:25.200ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-02-28T11:04:25.200ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-02-28T11:04:25.201ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-02-28T11:04:25.201ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-02-28T11:04:25.201ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-02-28T11:04:25.201ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4056
2372025-02-28T11:04:25.201ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:48416
2382025-02-28T11:04:25.413ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-02-28T11:04:25.413ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-02-28T11:04:25.418ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4377 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412025-02-28T11:04:25.418ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4393
2422025-02-28T11:04:25.418ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:535 zone = oxz_switch
2432025-02-28T11:04:25.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43829
2442025-02-28T11:04:25.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-02-28T11:04:25.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-02-28T11:04:25.673ZINFOSledAgent (ServiceManager): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-02-28T11:04:25.673ZINFOSledAgent (ServiceManager): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-02-28T11:04:25.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43829 req_id = 4372beba-58ee-47bc-96f5-755dc25d6e60 response_code = 200 uri = /inventory
2492025-02-28T11:04:25.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39570
2502025-02-28T11:04:25.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39570 req_id = ba729d9d-fafe-43dc-bd7e-fa70eb9c7400 response_code = 200 uri = /sled-role
2512025-02-28T11:04:25.733ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 00008586-f3fc-4cf9-b99a-f3b58bbd4166 (physical_disk), pool_id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 44b304f5-8f3d-4769-b03e-f21f941228b7 (physical_disk), pool_id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6c23e7de-a5b2-41c8-9ecd-ac84acfdb93e (physical_disk), pool_id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b236a7ab-1ccc-4588-a7da-5cb1f6c82a73 (physical_disk), pool_id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b55931d9-b9b0-4cc3-9477-edf881fb777b (physical_disk), pool_id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c720cb67-0f8f-416b-b90c-893b5cf6b503 (physical_disk), pool_id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d1ea3716-5ad9-4efd-abc8-e6fb18b6539e (physical_disk), pool_id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: da4ab763-32cf-420d-9704-369ba8959adb (physical_disk), pool_id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f6637bab-eeba-4c9e-9a2b-683f1d226f31 (physical_disk), pool_id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522025-02-28T11:04:25.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54950
2532025-02-28T11:04:25.733ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2542025-02-28T11:04:25.734ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 00008586-f3fc-4cf9-b99a-f3b58bbd4166 (physical_disk), pool_id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 44b304f5-8f3d-4769-b03e-f21f941228b7 (physical_disk), pool_id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6c23e7de-a5b2-41c8-9ecd-ac84acfdb93e (physical_disk), pool_id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b236a7ab-1ccc-4588-a7da-5cb1f6c82a73 (physical_disk), pool_id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b55931d9-b9b0-4cc3-9477-edf881fb777b (physical_disk), pool_id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c720cb67-0f8f-416b-b90c-893b5cf6b503 (physical_disk), pool_id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d1ea3716-5ad9-4efd-abc8-e6fb18b6539e (physical_disk), pool_id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: da4ab763-32cf-420d-9704-369ba8959adb (physical_disk), pool_id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f6637bab-eeba-4c9e-9a2b-683f1d226f31 (physical_disk), pool_id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552025-02-28T11:04:25.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-02-28T11:04:25.734ZINFOSledAgent (StorageManager): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-02-28T11:04:25.734ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582025-02-28T11:04:25.734ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592025-02-28T11:04:25.734ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602025-02-28T11:04:25.734ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612025-02-28T11:04:25.734ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622025-02-28T11:04:25.863ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632025-02-28T11:04:25.863ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool)
2642025-02-28T11:04:26.285ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2652025-02-28T11:04:26.286ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2662025-02-28T11:04:26.287ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2672025-02-28T11:04:26.287ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
2682025-02-28T11:04:26.350ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }
2692025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752025-02-28T11:04:26.358ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762025-02-28T11:04:26.392ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772025-02-28T11:04:26.399ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/zone file = sled-storage/src/dataset.rs:302
2782025-02-28T11:04:26.532ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a file = sled-storage/src/dataset.rs:388
2792025-02-28T11:04:26.540ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802025-02-28T11:04:26.540ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812025-02-28T11:04:26.540ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822025-02-28T11:04:26.540ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832025-02-28T11:04:26.540ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842025-02-28T11:04:26.550ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852025-02-28T11:04:26.550ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool)
2862025-02-28T11:04:26.643ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }
2872025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-02-28T11:04:26.652ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942025-02-28T11:04:26.687ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-02-28T11:04:26.694ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-02-28T11:04:26.830ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528 file = sled-storage/src/dataset.rs:388
2972025-02-28T11:04:26.838ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-02-28T11:04:26.838ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-02-28T11:04:26.838ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-02-28T11:04:26.838ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-02-28T11:04:26.838ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-02-28T11:04:26.847ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-02-28T11:04:26.847ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool)
3042025-02-28T11:04:26.937ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }
3052025-02-28T11:04:26.944ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-02-28T11:04:26.944ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-02-28T11:04:26.944ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-02-28T11:04:26.944ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-02-28T11:04:26.944ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-02-28T11:04:26.945ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-02-28T11:04:26.945ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-02-28T11:04:26.980ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-02-28T11:04:26.988ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-02-28T11:04:27.132ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275 file = sled-storage/src/dataset.rs:388
3152025-02-28T11:04:27.140ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-02-28T11:04:27.140ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-02-28T11:04:27.140ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-02-28T11:04:27.140ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-02-28T11:04:27.140ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-02-28T11:04:27.150ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-02-28T11:04:27.150ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fa8e53ef-f341-4626-a351-436b60107fd4 (zpool)
3222025-02-28T11:04:27.246ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }
3232025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-02-28T11:04:27.254ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-02-28T11:04:27.289ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
3312025-02-28T11:04:27.290ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322025-02-28T11:04:27.299ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone file = sled-storage/src/dataset.rs:302
3332025-02-28T11:04:27.445ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fa8e53ef-f341-4626-a351-436b60107fd4 file = sled-storage/src/dataset.rs:388
3342025-02-28T11:04:27.453ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352025-02-28T11:04:27.453ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362025-02-28T11:04:27.453ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372025-02-28T11:04:27.453ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382025-02-28T11:04:27.453ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392025-02-28T11:04:27.463ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402025-02-28T11:04:27.463ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dce85aac-5feb-46f0-9268-e34ae310482f (zpool)
3412025-02-28T11:04:27.558ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }
3422025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-02-28T11:04:27.566ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492025-02-28T11:04:27.603ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502025-02-28T11:04:27.612ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone file = sled-storage/src/dataset.rs:302
3512025-02-28T11:04:27.750ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dce85aac-5feb-46f0-9268-e34ae310482f file = sled-storage/src/dataset.rs:388
3522025-02-28T11:04:27.758ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532025-02-28T11:04:27.758ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542025-02-28T11:04:27.758ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552025-02-28T11:04:27.758ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562025-02-28T11:04:27.758ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572025-02-28T11:04:27.768ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582025-02-28T11:04:27.768ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool)
3592025-02-28T11:04:27.862ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }
3602025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-02-28T11:04:27.871ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672025-02-28T11:04:27.907ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-02-28T11:04:27.915ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-02-28T11:04:28.059ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb file = sled-storage/src/dataset.rs:388
3702025-02-28T11:04:28.067ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-02-28T11:04:28.067ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-02-28T11:04:28.067ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-02-28T11:04:28.067ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-02-28T11:04:28.067ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-02-28T11:04:28.077ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-02-28T11:04:28.077ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool)
3772025-02-28T11:04:28.174ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }
3782025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-02-28T11:04:28.182ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-02-28T11:04:28.217ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862025-02-28T11:04:28.225ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone file = sled-storage/src/dataset.rs:302
3872025-02-28T11:04:28.291ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
3882025-02-28T11:04:28.369ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59 file = sled-storage/src/dataset.rs:388
3892025-02-28T11:04:28.377ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902025-02-28T11:04:28.377ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912025-02-28T11:04:28.377ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922025-02-28T11:04:28.377ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932025-02-28T11:04:28.377ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942025-02-28T11:04:28.387ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952025-02-28T11:04:28.387ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool)
3962025-02-28T11:04:28.478ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }
3972025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-02-28T11:04:28.486ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042025-02-28T11:04:28.518ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052025-02-28T11:04:28.525ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone file = sled-storage/src/dataset.rs:302
4062025-02-28T11:04:28.658ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_57c9df87-515e-406c-b81d-f5a8f2f31360 file = sled-storage/src/dataset.rs:388
4072025-02-28T11:04:28.666ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082025-02-28T11:04:28.666ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092025-02-28T11:04:28.666ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102025-02-28T11:04:28.666ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112025-02-28T11:04:28.666ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122025-02-28T11:04:28.676ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132025-02-28T11:04:28.676ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool)
4142025-02-28T11:04:28.766ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }
4152025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-02-28T11:04:28.773ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222025-02-28T11:04:28.806ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232025-02-28T11:04:28.813ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone file = sled-storage/src/dataset.rs:302
4242025-02-28T11:04:28.953ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3eced58b-69b0-4a58-a7df-32c6431e950a file = sled-storage/src/dataset.rs:388
4252025-02-28T11:04:28.960ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-02-28T11:04:28.960ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-02-28T11:04:28.961ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-02-28T11:04:28.961ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df51d52c-5b47-4a54-948d-b88bd4a86cfe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-02-28T11:04:28.961ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-02-28T11:04:28.961ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-02-28T11:04:28.961ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4332025-02-28T11:04:28.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4352025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4362025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4372025-02-28T11:04:28.961ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4382025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4392025-02-28T11:04:28.961ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-02-28T11:04:28.961ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4412025-02-28T11:04:28.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3227980 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54950 req_id = 05072506-9a66-4308-9e66-ad9691123b9f response_code = 200 uri = /omicron-physical-disks
4422025-02-28T11:04:28.993ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0537dc43-d6a2-4006-85e7-88e4e12a839e (dataset): DatasetConfig { id: 0537dc43-d6a2-4006-85e7-88e4e12a839e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08185aef-4126-483a-b68b-81746b63117c (dataset): DatasetConfig { id: 08185aef-4126-483a-b68b-81746b63117c (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0937ec1a-fd1c-4d02-a398-48e165e5c66e (dataset): DatasetConfig { id: 0937ec1a-fd1c-4d02-a398-48e165e5c66e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0beb3d4b-6581-4051-b28b-7c98df9212f1 (dataset): DatasetConfig { id: 0beb3d4b-6581-4051-b28b-7c98df9212f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13b12004-109f-4bab-90c9-42b9325d43af (dataset): DatasetConfig { id: 13b12004-109f-4bab-90c9-42b9325d43af (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18d5ff71-1986-4e15-b8ab-fda08585b3ec (dataset): DatasetConfig { id: 18d5ff71-1986-4e15-b8ab-fda08585b3ec (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1abbebbe-2a18-4d4e-8e3b-a376c23c8c80 (dataset): DatasetConfig { id: 1abbebbe-2a18-4d4e-8e3b-a376c23c8c80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d907c73-96dc-41f5-82db-f206dd1aca6c (dataset): DatasetConfig { id: 1d907c73-96dc-41f5-82db-f206dd1aca6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 267f8b60-4475-4ace-bd43-270a57f5c915 (dataset): DatasetConfig { id: 267f8b60-4475-4ace-bd43-270a57f5c915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e1d1578-8059-489a-8f80-40dbe70e1f4f (dataset): DatasetConfig { id: 2e1d1578-8059-489a-8f80-40dbe70e1f4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ed899e-5193-45e2-9144-d098affb3ce0 (dataset): DatasetConfig { id: 32ed899e-5193-45e2-9144-d098affb3ce0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 341dff65-25e3-4b41-8b7e-9071f5d1ef23 (dataset): DatasetConfig { id: 341dff65-25e3-4b41-8b7e-9071f5d1ef23 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35340e0b-7a63-4d25-89d9-32c30a91c7b7 (dataset): DatasetConfig { id: 35340e0b-7a63-4d25-89d9-32c30a91c7b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 379c757d-485f-4d8a-af27-c771e3120896 (dataset): DatasetConfig { id: 379c757d-485f-4d8a-af27-c771e3120896 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bcbfd61-45fc-4171-a058-b84673310f39 (dataset): DatasetConfig { id: 3bcbfd61-45fc-4171-a058-b84673310f39 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d64c369-84b9-44c5-8743-ad1f72d8c8ec (dataset): DatasetConfig { id: 3d64c369-84b9-44c5-8743-ad1f72d8c8ec (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fcaab5e-ec6e-4f95-a4eb-0b47fb4d6d0c (dataset): DatasetConfig { id: 3fcaab5e-ec6e-4f95-a4eb-0b47fb4d6d0c (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 401c01fc-42de-41de-9634-d8897daa7b3e (dataset): DatasetConfig { id: 401c01fc-42de-41de-9634-d8897daa7b3e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 435e2480-eda3-4113-ae49-839f20a420cf (dataset): DatasetConfig { id: 435e2480-eda3-4113-ae49-839f20a420cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43f5a871-2ac5-4b9c-8eb6-476283e44845 (dataset): DatasetConfig { id: 43f5a871-2ac5-4b9c-8eb6-476283e44845 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 442ce07e-c071-43a9-96c6-ef2edef68388 (dataset): DatasetConfig { id: 442ce07e-c071-43a9-96c6-ef2edef68388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45094700-292c-48f9-b887-3110ba7115ef (dataset): DatasetConfig { id: 45094700-292c-48f9-b887-3110ba7115ef (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 466a3b4c-1ee2-4b1e-b13c-6fa17aa6c894 (dataset): DatasetConfig { id: 466a3b4c-1ee2-4b1e-b13c-6fa17aa6c894 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49b14aa0-92da-42d7-a378-215725991aea (dataset): DatasetConfig { id: 49b14aa0-92da-42d7-a378-215725991aea (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f1355cc-327f-439b-849f-9cb1fd075ad2 (dataset): DatasetConfig { id: 4f1355cc-327f-439b-849f-9cb1fd075ad2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56915554-3b69-4a9d-9497-d51b8bfa6156 (dataset): DatasetConfig { id: 56915554-3b69-4a9d-9497-d51b8bfa6156 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b6e0fdd-1c56-4d80-933c-5e234276155b (dataset): DatasetConfig { id: 5b6e0fdd-1c56-4d80-933c-5e234276155b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a43424-6d00-426e-9e7b-849c4ed20586 (dataset): DatasetConfig { id: 66a43424-6d00-426e-9e7b-849c4ed20586 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 66dffec8-278a-4470-8de6-e62c79068a0e (dataset): DatasetConfig { id: 66dffec8-278a-4470-8de6-e62c79068a0e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6efdcc97-4701-4225-a2a7-96fe61c272de (dataset): DatasetConfig { id: 6efdcc97-4701-4225-a2a7-96fe61c272de (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f376bc2-bde7-4c49-a086-09e334bf30ae (dataset): DatasetConfig { id: 6f376bc2-bde7-4c49-a086-09e334bf30ae (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70a0cc8f-87b4-4a59-88a9-df918964c266 (dataset): DatasetConfig { id: 70a0cc8f-87b4-4a59-88a9-df918964c266 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 785aa419-b630-4c71-9ea9-28b4da164ec1 (dataset): DatasetConfig { id: 785aa419-b630-4c71-9ea9-28b4da164ec1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a22ebdf-0747-44a5-957a-cfd4b8d18a94 (dataset): DatasetConfig { id: 7a22ebdf-0747-44a5-957a-cfd4b8d18a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86331f1e-cef5-48ea-adf1-a2052f066646 (dataset): DatasetConfig { id: 86331f1e-cef5-48ea-adf1-a2052f066646 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e11d3ed-76eb-4226-808a-a0b4fe85531d (dataset): DatasetConfig { id: 8e11d3ed-76eb-4226-808a-a0b4fe85531d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91068cc7-35c4-4641-9c5d-c8e8ea5f30f7 (dataset): DatasetConfig { id: 91068cc7-35c4-4641-9c5d-c8e8ea5f30f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95225800-881c-432e-a443-121743c1a83a (dataset): DatasetConfig { id: 95225800-881c-432e-a443-121743c1a83a (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b59617d-09cc-4e9b-86a9-3e22fe29d7b6 (dataset): DatasetConfig { id: 9b59617d-09cc-4e9b-86a9-3e22fe29d7b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dc0f656-9fa1-450a-9286-51bdffebc8da (dataset): DatasetConfig { id: 9dc0f656-9fa1-450a-9286-51bdffebc8da (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2a6f618-5728-4d6a-8eb5-b5c908acb5f4 (dataset): DatasetConfig { id: a2a6f618-5728-4d6a-8eb5-b5c908acb5f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa68aee9-f507-4236-98e0-aca7749116af (dataset): DatasetConfig { id: aa68aee9-f507-4236-98e0-aca7749116af (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aac19322-2bc5-46ff-93e8-2146828e80c3 (dataset): DatasetConfig { id: aac19322-2bc5-46ff-93e8-2146828e80c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b20fa94f-c569-4716-9fab-44a0f264df05 (dataset): DatasetConfig { id: b20fa94f-c569-4716-9fab-44a0f264df05 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b675c3c5-74c8-4233-88e9-c47ecfdd09a4 (dataset): DatasetConfig { id: b675c3c5-74c8-4233-88e9-c47ecfdd09a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6cf0b4e-d5f7-4f3f-a6c9-e6f7675de944 (dataset): DatasetConfig { id: b6cf0b4e-d5f7-4f3f-a6c9-e6f7675de944 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83a4785-f5de-4654-abff-52ec5e581bef (dataset): DatasetConfig { id: b83a4785-f5de-4654-abff-52ec5e581bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b96d52ce-24e3-4ebb-94d4-f733ee61cf78 (dataset): DatasetConfig { id: b96d52ce-24e3-4ebb-94d4-f733ee61cf78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c01966bc-d00b-4fe4-a382-75b4f84ddf74 (dataset): DatasetConfig { id: c01966bc-d00b-4fe4-a382-75b4f84ddf74 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c23840da-fa0e-4e33-a5f3-9756a24a6aba (dataset): DatasetConfig { id: c23840da-fa0e-4e33-a5f3-9756a24a6aba (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c46b3ddb-13a0-4e4a-9fa2-9c75ac9a972d (dataset): DatasetConfig { id: c46b3ddb-13a0-4e4a-9fa2-9c75ac9a972d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb5b08f3-d1c8-4af8-b521-7eb3b97c9ba1 (dataset): DatasetConfig { id: cb5b08f3-d1c8-4af8-b521-7eb3b97c9ba1 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cd444263-94c3-45a3-a52c-cf1f0b65e174 (dataset): DatasetConfig { id: cd444263-94c3-45a3-a52c-cf1f0b65e174 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce9bb47b-0541-456b-801c-169c76b71f2e (dataset): DatasetConfig { id: ce9bb47b-0541-456b-801c-169c76b71f2e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1cb55cd-a4f5-483e-a577-d3aa539514d9 (dataset): DatasetConfig { id: d1cb55cd-a4f5-483e-a577-d3aa539514d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6ec84b6-9677-484d-8f59-e8923c68218f (dataset): DatasetConfig { id: d6ec84b6-9677-484d-8f59-e8923c68218f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2cc0be1-0948-4f85-acae-0233f2e19cda (dataset): DatasetConfig { id: e2cc0be1-0948-4f85-acae-0233f2e19cda (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8b40309-5236-4443-95d0-e146d6632d3f (dataset): DatasetConfig { id: e8b40309-5236-4443-95d0-e146d6632d3f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edb3b90d-1b12-4850-9106-b38a599a8e16 (dataset): DatasetConfig { id: edb3b90d-1b12-4850-9106-b38a599a8e16 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee08545a-95ce-4e1e-809d-fb115a30a099 (dataset): DatasetConfig { id: ee08545a-95ce-4e1e-809d-fb115a30a099 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5a34e62-91e7-4987-a752-10f337bdb452 (dataset): DatasetConfig { id: f5a34e62-91e7-4987-a752-10f337bdb452 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f751bac1-cee9-464f-8922-8f35a3db9311 (dataset): DatasetConfig { id: f751bac1-cee9-464f-8922-8f35a3db9311 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f775204f-a1c6-4ce4-9905-b0863f6e7c2e (dataset): DatasetConfig { id: f775204f-a1c6-4ce4-9905-b0863f6e7c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7c5a802-7a76-4fde-9fdf-abd5bfb6f1c2 (dataset): DatasetConfig { id: f7c5a802-7a76-4fde-9fdf-abd5bfb6f1c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa0ee0ca-afb9-4963-bda8-2feff7ae94ef (dataset): DatasetConfig { id: fa0ee0ca-afb9-4963-bda8-2feff7ae94ef (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa43744c-be62-4d76-964c-960f76432413 (dataset): DatasetConfig { id: fa43744c-be62-4d76-964c-960f76432413 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432025-02-28T11:04:28.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34643
4442025-02-28T11:04:28.993ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4452025-02-28T11:04:28.993ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0537dc43-d6a2-4006-85e7-88e4e12a839e (dataset): DatasetConfig { id: 0537dc43-d6a2-4006-85e7-88e4e12a839e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08185aef-4126-483a-b68b-81746b63117c (dataset): DatasetConfig { id: 08185aef-4126-483a-b68b-81746b63117c (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0937ec1a-fd1c-4d02-a398-48e165e5c66e (dataset): DatasetConfig { id: 0937ec1a-fd1c-4d02-a398-48e165e5c66e (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0beb3d4b-6581-4051-b28b-7c98df9212f1 (dataset): DatasetConfig { id: 0beb3d4b-6581-4051-b28b-7c98df9212f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13b12004-109f-4bab-90c9-42b9325d43af (dataset): DatasetConfig { id: 13b12004-109f-4bab-90c9-42b9325d43af (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18d5ff71-1986-4e15-b8ab-fda08585b3ec (dataset): DatasetConfig { id: 18d5ff71-1986-4e15-b8ab-fda08585b3ec (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1abbebbe-2a18-4d4e-8e3b-a376c23c8c80 (dataset): DatasetConfig { id: 1abbebbe-2a18-4d4e-8e3b-a376c23c8c80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d907c73-96dc-41f5-82db-f206dd1aca6c (dataset): DatasetConfig { id: 1d907c73-96dc-41f5-82db-f206dd1aca6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 267f8b60-4475-4ace-bd43-270a57f5c915 (dataset): DatasetConfig { id: 267f8b60-4475-4ace-bd43-270a57f5c915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e1d1578-8059-489a-8f80-40dbe70e1f4f (dataset): DatasetConfig { id: 2e1d1578-8059-489a-8f80-40dbe70e1f4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32ed899e-5193-45e2-9144-d098affb3ce0 (dataset): DatasetConfig { id: 32ed899e-5193-45e2-9144-d098affb3ce0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 341dff65-25e3-4b41-8b7e-9071f5d1ef23 (dataset): DatasetConfig { id: 341dff65-25e3-4b41-8b7e-9071f5d1ef23 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35340e0b-7a63-4d25-89d9-32c30a91c7b7 (dataset): DatasetConfig { id: 35340e0b-7a63-4d25-89d9-32c30a91c7b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 379c757d-485f-4d8a-af27-c771e3120896 (dataset): DatasetConfig { id: 379c757d-485f-4d8a-af27-c771e3120896 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3bcbfd61-45fc-4171-a058-b84673310f39 (dataset): DatasetConfig { id: 3bcbfd61-45fc-4171-a058-b84673310f39 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d64c369-84b9-44c5-8743-ad1f72d8c8ec (dataset): DatasetConfig { id: 3d64c369-84b9-44c5-8743-ad1f72d8c8ec (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fcaab5e-ec6e-4f95-a4eb-0b47fb4d6d0c (dataset): DatasetConfig { id: 3fcaab5e-ec6e-4f95-a4eb-0b47fb4d6d0c (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 401c01fc-42de-41de-9634-d8897daa7b3e (dataset): DatasetConfig { id: 401c01fc-42de-41de-9634-d8897daa7b3e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 435e2480-eda3-4113-ae49-839f20a420cf (dataset): DatasetConfig { id: 435e2480-eda3-4113-ae49-839f20a420cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43f5a871-2ac5-4b9c-8eb6-476283e44845 (dataset): DatasetConfig { id: 43f5a871-2ac5-4b9c-8eb6-476283e44845 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 442ce07e-c071-43a9-96c6-ef2edef68388 (dataset): DatasetConfig { id: 442ce07e-c071-43a9-96c6-ef2edef68388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45094700-292c-48f9-b887-3110ba7115ef (dataset): DatasetConfig { id: 45094700-292c-48f9-b887-3110ba7115ef (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 466a3b4c-1ee2-4b1e-b13c-6fa17aa6c894 (dataset): DatasetConfig { id: 466a3b4c-1ee2-4b1e-b13c-6fa17aa6c894 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49b14aa0-92da-42d7-a378-215725991aea (dataset): DatasetConfig { id: 49b14aa0-92da-42d7-a378-215725991aea (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f1355cc-327f-439b-849f-9cb1fd075ad2 (dataset): DatasetConfig { id: 4f1355cc-327f-439b-849f-9cb1fd075ad2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56915554-3b69-4a9d-9497-d51b8bfa6156 (dataset): DatasetConfig { id: 56915554-3b69-4a9d-9497-d51b8bfa6156 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b6e0fdd-1c56-4d80-933c-5e234276155b (dataset): DatasetConfig { id: 5b6e0fdd-1c56-4d80-933c-5e234276155b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66a43424-6d00-426e-9e7b-849c4ed20586 (dataset): DatasetConfig { id: 66a43424-6d00-426e-9e7b-849c4ed20586 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 66dffec8-278a-4470-8de6-e62c79068a0e (dataset): DatasetConfig { id: 66dffec8-278a-4470-8de6-e62c79068a0e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6efdcc97-4701-4225-a2a7-96fe61c272de (dataset): DatasetConfig { id: 6efdcc97-4701-4225-a2a7-96fe61c272de (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f376bc2-bde7-4c49-a086-09e334bf30ae (dataset): DatasetConfig { id: 6f376bc2-bde7-4c49-a086-09e334bf30ae (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70a0cc8f-87b4-4a59-88a9-df918964c266 (dataset): DatasetConfig { id: 70a0cc8f-87b4-4a59-88a9-df918964c266 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 785aa419-b630-4c71-9ea9-28b4da164ec1 (dataset): DatasetConfig { id: 785aa419-b630-4c71-9ea9-28b4da164ec1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a22ebdf-0747-44a5-957a-cfd4b8d18a94 (dataset): DatasetConfig { id: 7a22ebdf-0747-44a5-957a-cfd4b8d18a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86331f1e-cef5-48ea-adf1-a2052f066646 (dataset): DatasetConfig { id: 86331f1e-cef5-48ea-adf1-a2052f066646 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e11d3ed-76eb-4226-808a-a0b4fe85531d (dataset): DatasetConfig { id: 8e11d3ed-76eb-4226-808a-a0b4fe85531d (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91068cc7-35c4-4641-9c5d-c8e8ea5f30f7 (dataset): DatasetConfig { id: 91068cc7-35c4-4641-9c5d-c8e8ea5f30f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95225800-881c-432e-a443-121743c1a83a (dataset): DatasetConfig { id: 95225800-881c-432e-a443-121743c1a83a (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b59617d-09cc-4e9b-86a9-3e22fe29d7b6 (dataset): DatasetConfig { id: 9b59617d-09cc-4e9b-86a9-3e22fe29d7b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9dc0f656-9fa1-450a-9286-51bdffebc8da (dataset): DatasetConfig { id: 9dc0f656-9fa1-450a-9286-51bdffebc8da (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2a6f618-5728-4d6a-8eb5-b5c908acb5f4 (dataset): DatasetConfig { id: a2a6f618-5728-4d6a-8eb5-b5c908acb5f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, aa68aee9-f507-4236-98e0-aca7749116af (dataset): DatasetConfig { id: aa68aee9-f507-4236-98e0-aca7749116af (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aac19322-2bc5-46ff-93e8-2146828e80c3 (dataset): DatasetConfig { id: aac19322-2bc5-46ff-93e8-2146828e80c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b20fa94f-c569-4716-9fab-44a0f264df05 (dataset): DatasetConfig { id: b20fa94f-c569-4716-9fab-44a0f264df05 (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b675c3c5-74c8-4233-88e9-c47ecfdd09a4 (dataset): DatasetConfig { id: b675c3c5-74c8-4233-88e9-c47ecfdd09a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6cf0b4e-d5f7-4f3f-a6c9-e6f7675de944 (dataset): DatasetConfig { id: b6cf0b4e-d5f7-4f3f-a6c9-e6f7675de944 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83a4785-f5de-4654-abff-52ec5e581bef (dataset): DatasetConfig { id: b83a4785-f5de-4654-abff-52ec5e581bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b96d52ce-24e3-4ebb-94d4-f733ee61cf78 (dataset): DatasetConfig { id: b96d52ce-24e3-4ebb-94d4-f733ee61cf78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c01966bc-d00b-4fe4-a382-75b4f84ddf74 (dataset): DatasetConfig { id: c01966bc-d00b-4fe4-a382-75b4f84ddf74 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c23840da-fa0e-4e33-a5f3-9756a24a6aba (dataset): DatasetConfig { id: c23840da-fa0e-4e33-a5f3-9756a24a6aba (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c46b3ddb-13a0-4e4a-9fa2-9c75ac9a972d (dataset): DatasetConfig { id: c46b3ddb-13a0-4e4a-9fa2-9c75ac9a972d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb5b08f3-d1c8-4af8-b521-7eb3b97c9ba1 (dataset): DatasetConfig { id: cb5b08f3-d1c8-4af8-b521-7eb3b97c9ba1 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cd444263-94c3-45a3-a52c-cf1f0b65e174 (dataset): DatasetConfig { id: cd444263-94c3-45a3-a52c-cf1f0b65e174 (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce9bb47b-0541-456b-801c-169c76b71f2e (dataset): DatasetConfig { id: ce9bb47b-0541-456b-801c-169c76b71f2e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1cb55cd-a4f5-483e-a577-d3aa539514d9 (dataset): DatasetConfig { id: d1cb55cd-a4f5-483e-a577-d3aa539514d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6ec84b6-9677-484d-8f59-e8923c68218f (dataset): DatasetConfig { id: d6ec84b6-9677-484d-8f59-e8923c68218f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2cc0be1-0948-4f85-acae-0233f2e19cda (dataset): DatasetConfig { id: e2cc0be1-0948-4f85-acae-0233f2e19cda (dataset), name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8b40309-5236-4443-95d0-e146d6632d3f (dataset): DatasetConfig { id: e8b40309-5236-4443-95d0-e146d6632d3f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edb3b90d-1b12-4850-9106-b38a599a8e16 (dataset): DatasetConfig { id: edb3b90d-1b12-4850-9106-b38a599a8e16 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee08545a-95ce-4e1e-809d-fb115a30a099 (dataset): DatasetConfig { id: ee08545a-95ce-4e1e-809d-fb115a30a099 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5a34e62-91e7-4987-a752-10f337bdb452 (dataset): DatasetConfig { id: f5a34e62-91e7-4987-a752-10f337bdb452 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f751bac1-cee9-464f-8922-8f35a3db9311 (dataset): DatasetConfig { id: f751bac1-cee9-464f-8922-8f35a3db9311 (dataset), name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f775204f-a1c6-4ce4-9905-b0863f6e7c2e (dataset): DatasetConfig { id: f775204f-a1c6-4ce4-9905-b0863f6e7c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7c5a802-7a76-4fde-9fdf-abd5bfb6f1c2 (dataset): DatasetConfig { id: f7c5a802-7a76-4fde-9fdf-abd5bfb6f1c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa0ee0ca-afb9-4963-bda8-2feff7ae94ef (dataset): DatasetConfig { id: fa0ee0ca-afb9-4963-bda8-2feff7ae94ef (dataset), name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa43744c-be62-4d76-964c-960f76432413 (dataset): DatasetConfig { id: fa43744c-be62-4d76-964c-960f76432413 (dataset), name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-02-28T11:04:28.993ZINFOSledAgent (StorageManager): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-02-28T11:04:28.993ZINFOSledAgent (StorageManager): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-02-28T11:04:28.993ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-02-28T11:04:29.010ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-02-28T11:04:29.010ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-02-28T11:04:29.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4522025-02-28T11:04:29.083ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-02-28T11:04:29.083ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-02-28T11:04:29.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4552025-02-28T11:04:29.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-02-28T11:04:29.134ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-02-28T11:04:29.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crucible" } file = sled-storage/src/manager.rs:1431
4582025-02-28T11:04:29.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-02-28T11:04:29.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-02-28T11:04:29.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118" } file = sled-storage/src/manager.rs:1431
4612025-02-28T11:04:29.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-02-28T11:04:29.239ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4632025-02-28T11:04:29.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone" } file = sled-storage/src/manager.rs:1431
4642025-02-28T11:04:29.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-02-28T11:04:29.266ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4662025-02-28T11:04:29.266ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone"), full_name: "oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone" } file = sled-storage/src/manager.rs:1431
4672025-02-28T11:04:29.293ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
4682025-02-28T11:04:29.294ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-02-28T11:04:29.294ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702025-02-28T11:04:29.294ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3" } file = sled-storage/src/manager.rs:1431
4712025-02-28T11:04:29.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-02-28T11:04:29.353ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4732025-02-28T11:04:29.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/debug"), full_name: "oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/debug" } file = sled-storage/src/manager.rs:1431
4742025-02-28T11:04:29.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-02-28T11:04:29.383ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-02-28T11:04:29.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4772025-02-28T11:04:29.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-02-28T11:04:29.431ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792025-02-28T11:04:29.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone/oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992"), full_name: "oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone/oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992" } file = sled-storage/src/manager.rs:1431
4802025-02-28T11:04:29.488ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-02-28T11:04:29.488ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-02-28T11:04:29.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crucible" } file = sled-storage/src/manager.rs:1431
4832025-02-28T11:04:29.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-02-28T11:04:29.532ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4852025-02-28T11:04:29.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/debug"), full_name: "oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4862025-02-28T11:04:29.560ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-02-28T11:04:29.560ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882025-02-28T11:04:29.560ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/zone"), full_name: "oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4892025-02-28T11:04:29.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-02-28T11:04:29.588ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4912025-02-28T11:04:29.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/debug"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/debug" } file = sled-storage/src/manager.rs:1431
4922025-02-28T11:04:29.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-02-28T11:04:29.615ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-02-28T11:04:29.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4952025-02-28T11:04:29.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-02-28T11:04:29.665ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-02-28T11:04:29.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4982025-02-28T11:04:29.713ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-02-28T11:04:29.713ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-02-28T11:04:29.713ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5012025-02-28T11:04:29.761ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-02-28T11:04:29.761ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-02-28T11:04:29.761ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crucible" } file = sled-storage/src/manager.rs:1431
5042025-02-28T11:04:29.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-02-28T11:04:29.807ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-02-28T11:04:29.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be" } file = sled-storage/src/manager.rs:1431
5072025-02-28T11:04:29.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-02-28T11:04:29.867ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-02-28T11:04:29.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5102025-02-28T11:04:29.918ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-02-28T11:04:29.918ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-02-28T11:04:29.918ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crucible" } file = sled-storage/src/manager.rs:1431
5132025-02-28T11:04:29.967ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-02-28T11:04:29.967ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5152025-02-28T11:04:29.967ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/debug"), full_name: "oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/debug" } file = sled-storage/src/manager.rs:1431
5162025-02-28T11:04:29.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-02-28T11:04:29.996ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-02-28T11:04:29.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae" } file = sled-storage/src/manager.rs:1431
5192025-02-28T11:04:30.056ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-02-28T11:04:30.056ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-02-28T11:04:30.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone/oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31"), full_name: "oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone/oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31" } file = sled-storage/src/manager.rs:1431
5222025-02-28T11:04:30.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-02-28T11:04:30.116ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-02-28T11:04:30.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0" } file = sled-storage/src/manager.rs:1431
5252025-02-28T11:04:30.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-02-28T11:04:30.175ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5272025-02-28T11:04:30.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/debug"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/debug" } file = sled-storage/src/manager.rs:1431
5282025-02-28T11:04:30.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-02-28T11:04:30.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302025-02-28T11:04:30.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone/oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb"), full_name: "oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone/oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb" } file = sled-storage/src/manager.rs:1431
5312025-02-28T11:04:30.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-02-28T11:04:30.263ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5332025-02-28T11:04:30.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/debug"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5342025-02-28T11:04:30.294ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-02-28T11:04:30.294ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-02-28T11:04:30.294ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf" } file = sled-storage/src/manager.rs:1431
5372025-02-28T11:04:30.297ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
5382025-02-28T11:04:30.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-02-28T11:04:30.352ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-02-28T11:04:30.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c" } file = sled-storage/src/manager.rs:1431
5412025-02-28T11:04:30.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-02-28T11:04:30.413ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-02-28T11:04:30.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425" } file = sled-storage/src/manager.rs:1431
5442025-02-28T11:04:30.473ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-02-28T11:04:30.473ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-02-28T11:04:30.473ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5472025-02-28T11:04:30.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-02-28T11:04:30.521ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492025-02-28T11:04:30.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone" } file = sled-storage/src/manager.rs:1431
5502025-02-28T11:04:30.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-02-28T11:04:30.550ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-02-28T11:04:30.550ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b" } file = sled-storage/src/manager.rs:1431
5532025-02-28T11:04:30.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-02-28T11:04:30.608ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-02-28T11:04:30.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc" } file = sled-storage/src/manager.rs:1431
5562025-02-28T11:04:30.667ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-02-28T11:04:30.667ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-02-28T11:04:30.667ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone" } file = sled-storage/src/manager.rs:1431
5592025-02-28T11:04:30.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-02-28T11:04:30.695ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612025-02-28T11:04:30.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5622025-02-28T11:04:30.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-02-28T11:04:30.724ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-02-28T11:04:30.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53" } file = sled-storage/src/manager.rs:1431
5652025-02-28T11:04:30.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-02-28T11:04:30.783ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672025-02-28T11:04:30.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone/oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead"), full_name: "oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/zone/oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead" } file = sled-storage/src/manager.rs:1431
5682025-02-28T11:04:30.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-02-28T11:04:30.843ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-02-28T11:04:30.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76" } file = sled-storage/src/manager.rs:1431
5712025-02-28T11:04:30.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-02-28T11:04:30.903ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5732025-02-28T11:04:30.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/debug"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5742025-02-28T11:04:30.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-02-28T11:04:30.933ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-02-28T11:04:30.933ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31" } file = sled-storage/src/manager.rs:1431
5772025-02-28T11:04:30.993ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-02-28T11:04:30.993ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-02-28T11:04:30.993ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5802025-02-28T11:04:31.042ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-02-28T11:04:31.042ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-02-28T11:04:31.042ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/zone/oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555"), full_name: "oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/zone/oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555" } file = sled-storage/src/manager.rs:1431
5832025-02-28T11:04:31.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-02-28T11:04:31.104ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5852025-02-28T11:04:31.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/debug"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/debug" } file = sled-storage/src/manager.rs:1431
5862025-02-28T11:04:31.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-02-28T11:04:31.134ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-02-28T11:04:31.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crucible" } file = sled-storage/src/manager.rs:1431
5892025-02-28T11:04:31.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-02-28T11:04:31.184ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-02-28T11:04:31.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9" } file = sled-storage/src/manager.rs:1431
5922025-02-28T11:04:31.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-02-28T11:04:31.247ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-02-28T11:04:31.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97" } file = sled-storage/src/manager.rs:1431
5952025-02-28T11:04:31.299ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
5962025-02-28T11:04:31.300ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 21.497520746s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
5972025-02-28T11:04:31.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-02-28T11:04:31.308ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-02-28T11:04:31.308ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crucible" } file = sled-storage/src/manager.rs:1431
6002025-02-28T11:04:31.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-02-28T11:04:31.357ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6022025-02-28T11:04:31.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone" } file = sled-storage/src/manager.rs:1431
6032025-02-28T11:04:31.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-02-28T11:04:31.388ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052025-02-28T11:04:31.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone"), full_name: "oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/zone" } file = sled-storage/src/manager.rs:1431
6062025-02-28T11:04:31.418ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-02-28T11:04:31.418ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6082025-02-28T11:04:31.418ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/debug"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/debug" } file = sled-storage/src/manager.rs:1431
6092025-02-28T11:04:31.447ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-02-28T11:04:31.447ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-02-28T11:04:31.447ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc" } file = sled-storage/src/manager.rs:1431
6122025-02-28T11:04:31.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-02-28T11:04:31.509ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-02-28T11:04:31.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853" } file = sled-storage/src/manager.rs:1431
6152025-02-28T11:04:31.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-02-28T11:04:31.573ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-02-28T11:04:31.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e"), full_name: "oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/zone/oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e" } file = sled-storage/src/manager.rs:1431
6182025-02-28T11:04:31.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-02-28T11:04:31.634ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-02-28T11:04:31.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/zone/oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae" } file = sled-storage/src/manager.rs:1431
6212025-02-28T11:04:31.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-02-28T11:04:31.697ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-02-28T11:04:31.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738"), full_name: "oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/zone/oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738" } file = sled-storage/src/manager.rs:1431
6242025-02-28T11:04:31.758ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-02-28T11:04:31.758ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-02-28T11:04:31.758ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6272025-02-28T11:04:31.810ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-02-28T11:04:31.810ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-02-28T11:04:31.810ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crucible" } file = sled-storage/src/manager.rs:1431
6302025-02-28T11:04:31.859ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-02-28T11:04:31.859ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322025-02-28T11:04:31.859ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone/oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74" } file = sled-storage/src/manager.rs:1431
6332025-02-28T11:04:31.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-02-28T11:04:31.919ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-02-28T11:04:31.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270"), full_name: "oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/zone/oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270" } file = sled-storage/src/manager.rs:1431
6362025-02-28T11:04:31.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-02-28T11:04:31.982ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-02-28T11:04:31.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497"), full_name: "oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crypt/zone/oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497" } file = sled-storage/src/manager.rs:1431
6392025-02-28T11:04:32.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-02-28T11:04:32.043ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-02-28T11:04:32.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crucible" } file = sled-storage/src/manager.rs:1431
6422025-02-28T11:04:32.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-02-28T11:04:32.093ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6442025-02-28T11:04:32.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/zone" } file = sled-storage/src/manager.rs:1431
6452025-02-28T11:04:32.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-02-28T11:04:32.123ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-02-28T11:04:32.123ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crucible" } file = sled-storage/src/manager.rs:1431
6482025-02-28T11:04:32.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-02-28T11:04:32.172ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-02-28T11:04:32.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6512025-02-28T11:04:32.223ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-02-28T11:04:32.223ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532025-02-28T11:04:32.223ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
6542025-02-28T11:04:32.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3230768 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34643 req_id = b3295e62-3d6e-4e65-84c4-9f8ad452ed08 response_code = 200 uri = /datasets
6552025-02-28T11:04:32.255ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: e9dfcf5e-a922-4658-a776-3618551edd74 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: daf1508c-21c6-4c2b-91a0-3e717092a118 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: c58b6d59-7cb2-478f-9d27-4e70c13f0853 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562025-02-28T11:04:32.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42716
6572025-02-28T11:04:32.255ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-02-28T11:04:32.255ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-02-28T11:04:32.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-02-28T11:04:32.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-02-28T11:04:32.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-02-28T11:04:32.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-02-28T11:04:32.283ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-02-28T11:04:32.283ZINFOSledAgent (ServiceManager): No ledger in /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-02-28T11:04:32.283ZINFOSledAgent (ServiceManager): No ledger in /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-02-28T11:04:32.283ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6672025-02-28T11:04:32.283ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-02-28T11:04:32.301ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
6692025-02-28T11:04:32.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-02-28T11:04:32.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-02-28T11:04:32.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-02-28T11:04:32.378ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74 file = illumos-utils/src/zone.rs:325
6732025-02-28T11:04:32.382ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853 file = illumos-utils/src/zone.rs:325
6742025-02-28T11:04:32.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118 file = illumos-utils/src/zone.rs:325
6752025-02-28T11:04:32.399ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74 file = illumos-utils/src/zone.rs:363
6762025-02-28T11:04:32.403ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853 file = illumos-utils/src/zone.rs:363
6772025-02-28T11:04:32.407ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118 file = illumos-utils/src/zone.rs:363
6782025-02-28T11:04:33.303ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/probe_manager.rs:238 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
6792025-02-28T11:04:34.146ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-02-28T11:04:34.146ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6812025-02-28T11:04:34.627ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822025-02-28T11:04:35.104ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-02-28T11:04:35.104ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842025-02-28T11:04:35.104ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
6852025-02-28T11:04:35.108ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = sled-agent/src/services.rs:1066 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6862025-02-28T11:04:35.108ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
6872025-02-28T11:04:35.113ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
6882025-02-28T11:04:35.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
6892025-02-28T11:04:35.170ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
6902025-02-28T11:04:35.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 56.073249ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
6912025-02-28T11:04:35.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 56.261704ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
6922025-02-28T11:04:35.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 47.588707ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
6932025-02-28T11:04:35.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 134.404959ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
6942025-02-28T11:04:35.378ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 72.196733ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
6952025-02-28T11:04:35.442ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 66.556832ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
6962025-02-28T11:04:35.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 291.357743ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
6972025-02-28T11:04:35.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 146.508011ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
6982025-02-28T11:04:35.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 122.914788ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
6992025-02-28T11:04:35.760ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4401
7002025-02-28T11:04:35.760ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4411 gateway = fd00:1122:3344:101::1
7012025-02-28T11:04:35.778ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4425 gateway = fd00:1122:3344:101::1
7022025-02-28T11:04:35.778ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4490
7032025-02-28T11:04:35.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 268.089616ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7042025-02-28T11:04:35.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 438.96266ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7052025-02-28T11:04:35.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 339.355629ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7062025-02-28T11:04:36.125ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4531
7072025-02-28T11:04:36.125ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4558
7082025-02-28T11:04:36.172ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4571
7092025-02-28T11:04:36.172ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4442
7102025-02-28T11:04:36.210ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 867.166004ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7112025-02-28T11:04:36.231ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4484
7122025-02-28T11:04:36.231ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4538 rack_subnet = fd00:1122:3344::
7132025-02-28T11:04:36.252ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4549
7142025-02-28T11:04:36.252ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4622
7152025-02-28T11:04:36.290ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
7162025-02-28T11:04:36.290ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
7172025-02-28T11:04:36.332ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4654
7182025-02-28T11:04:36.332ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4660
7192025-02-28T11:04:36.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 680.31862ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7202025-02-28T11:04:36.419ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 994.356914ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7212025-02-28T11:04:36.441ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4701
7222025-02-28T11:04:36.441ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4574
7232025-02-28T11:04:36.566ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4607
7242025-02-28T11:04:36.566ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7252025-02-28T11:04:36.605ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/586e5b1c-fe84-4966-a99c-108aa56b2c5f) file = sled-agent/src/nexus.rs:530 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
7262025-02-28T11:04:36.605ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7272025-02-28T11:04:36.638ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7282025-02-28T11:04:36.638ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7292025-02-28T11:04:36.638ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7302025-02-28T11:04:36.638ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7312025-02-28T11:04:36.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
7322025-02-28T11:04:36.733ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7332025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7342025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7352025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7362025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7372025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7382025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7392025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7402025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7412025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7422025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7432025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7442025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7452025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7462025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7472025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7482025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7492025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7502025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7512025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7522025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7532025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7542025-02-28T11:04:36.733ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7552025-02-28T11:04:37.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 1.262251432s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7562025-02-28T11:04:37.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 567.464193ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7572025-02-28T11:04:37.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 900.687441ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7582025-02-28T11:04:37.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 965.512659ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7592025-02-28T11:04:38.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 567.576911ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7602025-02-28T11:04:38.335ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 839.17507ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7612025-02-28T11:04:38.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 933.678239ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7622025-02-28T11:04:38.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 581.998079ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7632025-02-28T11:04:39.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 1.446482204s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7642025-02-28T11:04:39.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 1.111752417s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7652025-02-28T11:04:39.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 721.847215ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7662025-02-28T11:04:40.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 938.860456ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7672025-02-28T11:04:40.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 693.025884ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7682025-02-28T11:04:40.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853") failed: Property not found. retry in 1.170114734s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7692025-02-28T11:04:41.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74") failed: Property not found. retry in 1.406786063s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7702025-02-28T11:04:41.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118") failed: Property not found. retry in 1.076452055s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7712025-02-28T11:04:42.692ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_e9dfcf5e-a922-4658-a776-3618551edd74
7722025-02-28T11:04:42.692ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_c58b6d59-7cb2-478f-9d27-4e70c13f0853
7732025-02-28T11:04:42.692ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_internal_dns_daf1508c-21c6-4c2b-91a0-3e717092a118
7742025-02-28T11:04:42.692ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7752025-02-28T11:04:42.693ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7762025-02-28T11:04:42.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10437647 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42716 req_id = 7ab528ec-0705-4c28-83a9-0d4dbde66341 response_code = 204 uri = /omicron-zones
7772025-02-28T11:04:42.695ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7782025-02-28T11:04:43.394ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 124.556548ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7792025-02-28T11:04:43.562ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7802025-02-28T11:04:43.642ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7812025-02-28T11:04:43.718ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7822025-02-28T11:04:43.718ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7832025-02-28T11:04:43.748ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7842025-02-28T11:04:43.748ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7852025-02-28T11:04:43.748ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7862025-02-28T11:04:43.777ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: e9dfcf5e-a922-4658-a776-3618551edd74 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: daf1508c-21c6-4c2b-91a0-3e717092a118 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: c58b6d59-7cb2-478f-9d27-4e70c13f0853 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 866941d2-4c43-4318-8945-46a2adbe895e (service), filesystem_pool: Some(ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bf6599a3-a940-4bd6-8da8-cae73b3b8320, kind: Service { id: 866941d2-4c43-4318-8945-46a2adbe895e }, name: Name("ntp-866941d2-4c43-4318-8945-46a2adbe895e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 183])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7872025-02-28T11:04:43.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54051
7882025-02-28T11:04:43.778ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892025-02-28T11:04:43.778ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902025-02-28T11:04:43.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7912025-02-28T11:04:43.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7922025-02-28T11:04:43.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7932025-02-28T11:04:43.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7942025-02-28T11:04:43.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-02-28T11:04:43.810ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
7962025-02-28T11:04:43.810ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
7972025-02-28T11:04:43.810ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7982025-02-28T11:04:43.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7992025-02-28T11:04:43.823ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
8002025-02-28T11:04:43.855ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
8012025-02-28T11:04:43.856ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
8022025-02-28T11:04:43.856ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
8032025-02-28T11:04:43.886ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 156, 183]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8042025-02-28T11:04:43.886ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = boundary_ntp
8052025-02-28T11:04:43.886ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8062025-02-28T11:04:43.886ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8072025-02-28T11:04:43.886ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8082025-02-28T11:04:43.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8092025-02-28T11:04:43.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e file = illumos-utils/src/zone.rs:325
8102025-02-28T11:04:43.930ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e file = illumos-utils/src/zone.rs:363
8112025-02-28T11:04:44.582ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8122025-02-28T11:04:44.582ZINFOSledAgent (ServiceManager): Booting oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8132025-02-28T11:04:44.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 74.865546ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8142025-02-28T11:04:44.809ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 83.06899ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8152025-02-28T11:04:44.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 108.714083ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8162025-02-28T11:04:45.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 396.241649ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8172025-02-28T11:04:45.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8182025-02-28T11:04:45.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8192025-02-28T11:04:45.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 1.020798389s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8202025-02-28T11:04:46.292ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8212025-02-28T11:04:46.292ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8222025-02-28T11:04:46.462ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 1.416855841s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8232025-02-28T11:04:47.887ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 1.163422515s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8242025-02-28T11:04:49.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 816.34999ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8252025-02-28T11:04:49.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e") failed: Property not found. retry in 1.440339593s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8262025-02-28T11:04:51.348ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e
8272025-02-28T11:04:51.348ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8282025-02-28T11:04:51.348ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8292025-02-28T11:04:51.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7570921 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54051 req_id = d66a70d9-e483-49cd-b842-815a5f682afe response_code = 204 uri = /omicron-zones
8302025-02-28T11:04:51.351ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8312025-02-28T11:04:51.381ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-02-28T11:04:51.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59861
8332025-02-28T11:04:51.390ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8342025-02-28T11:04:51.390ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59861 req_id = 7e218d35-e31a-4db1-953b-50507eb92a92 response_code = 500 uri = /timesync
8352025-02-28T11:04:51.393ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-02-28T11:04:51.532ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-02-28T11:04:51.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58573
8382025-02-28T11:04:51.833ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8392025-02-28T11:04:52.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8402025-02-28T11:04:52.695ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8412025-02-28T11:04:55.173ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8422025-02-28T11:04:55.173ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8432025-02-28T11:04:55.540ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8442025-02-28T11:04:55.540ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4007981 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58573 req_id = 259ad1cb-925d-43e4-ae27-d1be1406a925 response_code = 500 uri = /timesync
8452025-02-28T11:04:55.542ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-02-28T11:04:55.680ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-02-28T11:04:55.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61241
8482025-02-28T11:04:55.689ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8492025-02-28T11:04:55.689ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61241 req_id = 699ec205-4480-433a-bca5-0df19d077c78 response_code = 500 uri = /timesync
8502025-02-28T11:04:55.692ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-02-28T11:04:55.830ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-02-28T11:04:55.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45585
8532025-02-28T11:04:59.622ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_866941d2-4c43-4318-8945-46a2adbe895e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:4009
8542025-02-28T11:04:59.622ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45585 req_id = 54dbb03d-74dc-4fcb-953f-cd28d5758d6b response_code = 500 uri = /timesync
8552025-02-28T11:04:59.623ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8562025-02-28T11:04:59.623ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8572025-02-28T11:04:59.625ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-02-28T11:04:59.910ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-02-28T11:04:59.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59180
8602025-02-28T11:04:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59180 req_id = 3a878d23-f5f1-4a51-9a45-9ace160198f6 response_code = 200 uri = /timesync
8612025-02-28T11:04:59.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-02-28T11:04:59.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-02-28T11:05:00.176ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-02-28T11:05:00.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56004
8652025-02-28T11:05:00.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56004 req_id = dc4a8106-0664-416b-9a07-96ddd0d98c89 response_code = 200 uri = /timesync
8662025-02-28T11:05:00.187ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.496249884 } file = sled-agent/src/rack_setup/service.rs:743
8672025-02-28T11:05:00.187ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-02-28T11:05:00.459ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692025-02-28T11:05:00.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60982
8702025-02-28T11:05:00.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60982 req_id = b134a4b8-d2e1-4896-91e2-808a709009d2 response_code = 200 uri = /timesync
8712025-02-28T11:05:00.472ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.495482534 } file = sled-agent/src/rack_setup/service.rs:743
8722025-02-28T11:05:00.472ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-02-28T11:05:00.816ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742025-02-28T11:05:00.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51065
8752025-02-28T11:05:00.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51065 req_id = 9c60f1f5-d41f-47ba-99cf-b90d854adb3d response_code = 200 uri = /timesync
8762025-02-28T11:05:00.828ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.490412742 } file = sled-agent/src/rack_setup/service.rs:743
8772025-02-28T11:05:00.828ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782025-02-28T11:05:01.134ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8792025-02-28T11:05:01.134ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8802025-02-28T11:05:01.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-02-28T11:05:01.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36486
8822025-02-28T11:05:01.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36486 req_id = cb8501b0-c17f-4606-be5d-063592636cc9 response_code = 200 uri = /timesync
8832025-02-28T11:05:01.242ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.489295244 } file = sled-agent/src/rack_setup/service.rs:743
8842025-02-28T11:05:01.242ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-02-28T11:05:01.619ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8862025-02-28T11:05:01.790ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8872025-02-28T11:05:01.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44364
8882025-02-28T11:05:01.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44364 req_id = 9e6cee39-a61b-4cd9-b4c0-925853860014 response_code = 200 uri = /timesync
8892025-02-28T11:05:01.802ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.487760037 } file = sled-agent/src/rack_setup/service.rs:743
8902025-02-28T11:05:01.802ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8912025-02-28T11:05:02.181ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8922025-02-28T11:05:02.483ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
8932025-02-28T11:05:02.540ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942025-02-28T11:05:02.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55109
8952025-02-28T11:05:02.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7979 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55109 req_id = 1adde48f-4272-4395-922a-d29ded4db6d2 response_code = 200 uri = /timesync
8962025-02-28T11:05:02.552ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.485732973 } file = sled-agent/src/rack_setup/service.rs:743
8972025-02-28T11:05:02.552ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8982025-02-28T11:05:02.927ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992025-02-28T11:05:02.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43583
9002025-02-28T11:05:02.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7842 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43583 req_id = 0cc793af-8025-448b-a5a3-3fc7da29540d response_code = 200 uri = /timesync
9012025-02-28T11:05:02.939ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.484426588 } file = sled-agent/src/rack_setup/service.rs:743
9022025-02-28T11:05:02.939ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032025-02-28T11:05:03.411ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042025-02-28T11:05:03.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64560
9052025-02-28T11:05:03.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7859 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64560 req_id = 2864263b-d9e2-4d57-8021-96afad6a5842 response_code = 200 uri = /timesync
9062025-02-28T11:05:03.421ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.483120203 } file = sled-agent/src/rack_setup/service.rs:743
9072025-02-28T11:05:03.421ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082025-02-28T11:05:04.494ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9092025-02-28T11:05:04.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41006
9102025-02-28T11:05:04.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41006 req_id = d0f96b28-04ed-4bd8-a2ba-9358466461e6 response_code = 200 uri = /timesync
9112025-02-28T11:05:04.505ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1740740697.8681512, correction: 0.477115393 } file = sled-agent/src/rack_setup/service.rs:743
9122025-02-28T11:05:04.505ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9132025-02-28T11:05:04.968ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9142025-02-28T11:05:04.968ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9152025-02-28T11:05:05.373ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162025-02-28T11:05:05.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44715
9172025-02-28T11:05:05.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44715 req_id = f876c80e-dda5-4794-9add-7fd9a1a3a2f6 response_code = 200 uri = /timesync
9182025-02-28T11:05:05.383ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2900892866, ip_addr: 172.232.28.194, stratum: 3, ref_time: 1740740704.4362984, correction: 0.473624438 } file = sled-agent/src/rack_setup/service.rs:743
9192025-02-28T11:05:05.383ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-02-28T11:05:05.925ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41306
9212025-02-28T11:05:05.925ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41306 req_id = e0cda671-a2c4-4d61-bb0d-babad48c4e6e response_code = 200 uri = /baseboard
9222025-02-28T11:05:06.641ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9232025-02-28T11:05:06.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42497
9242025-02-28T11:05:06.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42497 req_id = 6823b5f1-e2df-4dc7-9b38-de7597bd1f86 response_code = 200 uri = /timesync
9252025-02-28T11:05:06.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2900892866, ip_addr: 172.232.28.194, stratum: 3, ref_time: 1740740705.817404, correction: 0.469537288 } file = sled-agent/src/rack_setup/service.rs:743
9262025-02-28T11:05:06.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9272025-02-28T11:05:07.636ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 134.452409ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9282025-02-28T11:05:08.632ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292025-02-28T11:05:08.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59624
9302025-02-28T11:05:08.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59624 req_id = 902d238b-0fb4-4fb1-b0b4-0575bb2be376 response_code = 200 uri = /timesync
9312025-02-28T11:05:08.644ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2900892866, ip_addr: 172.232.28.194, stratum: 3, ref_time: 1740740707.9454038, correction: 0.463254273 } file = sled-agent/src/rack_setup/service.rs:743
9322025-02-28T11:05:08.644ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9332025-02-28T11:05:09.649ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9342025-02-28T11:05:09.649ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9352025-02-28T11:05:11.106ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9362025-02-28T11:05:11.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44861
9372025-02-28T11:05:11.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8836 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44861 req_id = 0a472059-8116-4984-b9d6-59c2baadc3a4 response_code = 200 uri = /timesync
9382025-02-28T11:05:11.118ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2900892866, ip_addr: 172.232.28.194, stratum: 3, ref_time: 1740740710.2732005, correction: 0.456538349 } file = sled-agent/src/rack_setup/service.rs:743
9392025-02-28T11:05:11.118ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9402025-02-28T11:05:11.164ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9412025-02-28T11:05:11.164ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9422025-02-28T11:05:11.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9432025-02-28T11:05:12.211ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9442025-02-28T11:05:12.512ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9452025-02-28T11:05:14.251ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9462025-02-28T11:05:14.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46573
9472025-02-28T11:05:14.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8905 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46573 req_id = 6354d6e8-c1e6-443a-b826-da36ae1da818 response_code = 200 uri = /timesync
9482025-02-28T11:05:14.264ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740714.027293, correction: 0.448118836 } file = sled-agent/src/rack_setup/service.rs:743
9492025-02-28T11:05:14.264ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9502025-02-28T11:05:14.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9512025-02-28T11:05:14.997ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9522025-02-28T11:05:17.586ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9532025-02-28T11:05:17.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37117
9542025-02-28T11:05:17.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37117 req_id = 2344ce34-85bd-4b11-a7d2-3b33b2b587df response_code = 200 uri = /timesync
9552025-02-28T11:05:17.598ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740716.72345, correction: 0.439162552 } file = sled-agent/src/rack_setup/service.rs:743
9562025-02-28T11:05:17.598ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9572025-02-28T11:05:19.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9582025-02-28T11:05:19.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9592025-02-28T11:05:21.023ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9602025-02-28T11:05:21.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58360
9612025-02-28T11:05:21.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9077 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58360 req_id = 97f70972-1dd7-4c17-ad84-8b08c00ed025 response_code = 200 uri = /timesync
9622025-02-28T11:05:21.035ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740719.6937475, correction: 0.429866791 } file = sled-agent/src/rack_setup/service.rs:743
9632025-02-28T11:05:21.035ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9642025-02-28T11:05:21.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9652025-02-28T11:05:21.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9662025-02-28T11:05:21.678ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9672025-02-28T11:05:22.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9682025-02-28T11:05:22.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9692025-02-28T11:05:22.846ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 476.339927ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9702025-02-28T11:05:24.034ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9712025-02-28T11:05:24.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36822
9722025-02-28T11:05:24.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36822 req_id = ed1bb5ce-0492-498c-801d-cd0b9648e0b6 response_code = 200 uri = /timesync
9732025-02-28T11:05:24.046ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740723.0865262, correction: 0.421764553 } file = sled-agent/src/rack_setup/service.rs:743
9742025-02-28T11:05:24.046ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9752025-02-28T11:05:25.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9762025-02-28T11:05:25.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9772025-02-28T11:05:27.677ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9782025-02-28T11:05:27.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63939
9792025-02-28T11:05:27.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63939 req_id = 3cc6a2d1-5eaa-4f40-b168-70604f155e48 response_code = 200 uri = /timesync
9802025-02-28T11:05:27.689ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740726.5614333, correction: 0.411847025 } file = sled-agent/src/rack_setup/service.rs:743
9812025-02-28T11:05:27.689ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9822025-02-28T11:05:29.708ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9832025-02-28T11:05:29.708ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9842025-02-28T11:05:31.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9852025-02-28T11:05:31.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9862025-02-28T11:05:31.707ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9872025-02-28T11:05:32.267ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9882025-02-28T11:05:32.569ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9892025-02-28T11:05:33.329ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9902025-02-28T11:05:33.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50744
9912025-02-28T11:05:33.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8881 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50744 req_id = bc7e4fc2-8421-4b21-8cf7-0d4cc57866cf response_code = 200 uri = /timesync
9922025-02-28T11:05:33.341ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740732.2811592, correction: 0.396773726 } file = sled-agent/src/rack_setup/service.rs:743
9932025-02-28T11:05:33.341ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9942025-02-28T11:05:35.056ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6425015773373643758 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9952025-02-28T11:05:35.057ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16121926657072357244 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9962025-02-28T11:05:36.039ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60075
9972025-02-28T11:05:36.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60075 req_id = b1d2b887-ab7b-459b-8fd4-2e00481e910d response_code = 200 uri = /baseboard
9982025-02-28T11:05:38.399ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 869.181203ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
9992025-02-28T11:05:39.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10002025-02-28T11:05:39.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10012025-02-28T11:05:41.251ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10022025-02-28T11:05:41.251ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10032025-02-28T11:05:41.538ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10042025-02-28T11:05:41.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33097
10052025-02-28T11:05:41.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33097 req_id = ebf76454-49a1-421e-9620-47e29bfb5f44 response_code = 200 uri = /timesync
10062025-02-28T11:05:41.550ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740737.8943958, correction: 0.374500692 } file = sled-agent/src/rack_setup/service.rs:743
10072025-02-28T11:05:41.550ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10082025-02-28T11:05:41.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10092025-02-28T11:05:42.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10102025-02-28T11:05:42.598ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10112025-02-28T11:05:46.285ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10122025-02-28T11:05:46.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43588
10132025-02-28T11:05:46.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43588 req_id = 80e3d3c2-abea-4fbf-8763-91d788f658e3 response_code = 200 uri = /timesync
10142025-02-28T11:05:46.297ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740742.2749047, correction: 0.361624539 } file = sled-agent/src/rack_setup/service.rs:743
10152025-02-28T11:05:46.297ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10162025-02-28T11:05:49.766ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10172025-02-28T11:05:49.766ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10182025-02-28T11:05:51.281ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10192025-02-28T11:05:51.281ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10202025-02-28T11:05:51.766ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15502047974955195771 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10212025-02-28T11:05:52.324ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12072534479061565091 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10222025-02-28T11:05:52.626ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1707713372686561225 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10232025-02-28T11:05:54.345ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.44750677s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10242025-02-28T11:05:54.688ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10252025-02-28T11:05:54.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52811
10262025-02-28T11:05:54.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52811 req_id = 736d68e0-8541-4b83-bb44-af0682fdcff6 response_code = 200 uri = /timesync
10272025-02-28T11:05:54.700ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740746.6818123, correction: 0.338899165 } file = sled-agent/src/rack_setup/service.rs:743
10282025-02-28T11:05:54.700ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10292025-02-28T11:05:59.796ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10302025-02-28T11:05:59.796ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10312025-02-28T11:06:01.310ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13323235715355565164 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10322025-02-28T11:06:01.310ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9840717774274573755 reason = Duration(60s) sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10332025-02-28T11:06:03.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10342025-02-28T11:06:03.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57040
10352025-02-28T11:06:03.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57040 req_id = ce4e3dcc-d037-4d65-8ac5-c7bdb328ce70 response_code = 200 uri = /timesync
10362025-02-28T11:06:03.634ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740762.580008, correction: 0.314628452 } file = sled-agent/src/rack_setup/service.rs:743
10372025-02-28T11:06:03.634ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10382025-02-28T11:06:06.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51708
10392025-02-28T11:06:06.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51708 req_id = fb9a0d62-dd29-41da-951c-4bc4673c0ad5 response_code = 200 uri = /baseboard
10402025-02-28T11:06:09.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10412025-02-28T11:06:09.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10422025-02-28T11:06:11.875ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.244762854s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10432025-02-28T11:06:16.617ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10442025-02-28T11:06:16.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50610
10452025-02-28T11:06:16.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8807 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50610 req_id = 84f85a05-2370-40de-941b-894b3b687a80 response_code = 200 uri = /timesync
10462025-02-28T11:06:16.629ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740770.3207505, correction: 0.279462844 } file = sled-agent/src/rack_setup/service.rs:743
10472025-02-28T11:06:16.629ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10482025-02-28T11:06:19.854ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10492025-02-28T11:06:19.854ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10502025-02-28T11:06:29.883ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10512025-02-28T11:06:29.884ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10522025-02-28T11:06:31.207ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.152344817s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10532025-02-28T11:06:36.268ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55152
10542025-02-28T11:06:36.269ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55152 req_id = 6085d4b2-d692-44cd-9ca3-ad62edc791f6 response_code = 200 uri = /baseboard
10552025-02-28T11:06:37.410ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10562025-02-28T11:06:37.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39121
10572025-02-28T11:06:37.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39121 req_id = 7699e400-a9ba-4397-b8f2-a49542827c7f response_code = 200 uri = /timesync
10582025-02-28T11:06:37.421ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740794.8795042, correction: 0.223018423 } file = sled-agent/src/rack_setup/service.rs:743
10592025-02-28T11:06:37.421ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10602025-02-28T11:06:39.913ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10612025-02-28T11:06:39.913ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10622025-02-28T11:06:49.943ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10632025-02-28T11:06:49.943ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10642025-02-28T11:06:50.887ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10652025-02-28T11:06:50.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36624
10662025-02-28T11:06:50.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36624 req_id = b2a9760b-f547-4764-81f1-ae811c3543a5 response_code = 200 uri = /timesync
10672025-02-28T11:06:50.899ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740803.3845637, correction: 0.186520666 } file = sled-agent/src/rack_setup/service.rs:743
10682025-02-28T11:06:50.899ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10692025-02-28T11:06:56.461ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.334275223s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10702025-02-28T11:06:59.971ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10712025-02-28T11:06:59.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10722025-02-28T11:07:06.382ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60090
10732025-02-28T11:07:06.382ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60090 req_id = a72140f3-bb3a-4cd1-8e32-918d5059f6c2 response_code = 200 uri = /baseboard
10742025-02-28T11:07:10.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10752025-02-28T11:07:10.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10762025-02-28T11:07:20.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10772025-02-28T11:07:20.031ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10782025-02-28T11:07:22.151ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10792025-02-28T11:07:22.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45122
10802025-02-28T11:07:22.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45122 req_id = a1dbca7c-886b-46e8-b6cd-b23edece12c8 response_code = 200 uri = /timesync
10812025-02-28T11:07:22.163ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740835.799454, correction: 0.102646604 } file = sled-agent/src/rack_setup/service.rs:743
10822025-02-28T11:07:22.163ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10832025-02-28T11:07:29.923ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 35.136854632s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10842025-02-28T11:07:30.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10852025-02-28T11:07:30.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10862025-02-28T11:07:36.497ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62696
10872025-02-28T11:07:36.498ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62696 req_id = d9ea2d93-c341-45ea-bd2e-62d93e5326b8 response_code = 200 uri = /baseboard
10882025-02-28T11:07:40.090ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1731551177608602474 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10892025-02-28T11:07:40.090ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6181898994472685047 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10902025-02-28T11:07:43.958ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10912025-02-28T11:07:43.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60546
10922025-02-28T11:07:43.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60546 req_id = 9f926fc4-9549-459d-8e53-f030a9cfacb5 response_code = 200 uri = /timesync
10932025-02-28T11:07:43.980ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:05:35.056356373Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6425015773373643758 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10942025-02-28T11:07:43.981ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:05:51.766258346Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15502047974955195771 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10952025-02-28T11:07:43.982ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:05:52.324515879Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12072534479061565091 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10962025-02-28T11:07:43.982ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:05:52.626843823Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1707713372686561225 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10972025-02-28T11:07:43.982ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:06:01.310401075Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13323235715355565164 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10982025-02-28T11:07:43.982ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:06:01.310675065Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9840717774274573755 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
10992025-02-28T11:07:43.983ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-02-28T11:05:35.057024839Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16121926657072357244 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
11002025-02-28T11:07:43.984ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1740740859.8310328, correction: 0.043782163 } file = sled-agent/src/rack_setup/service.rs:743
11012025-02-28T11:07:43.984ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1378
11022025-02-28T11:07:44.014ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: e9dfcf5e-a922-4658-a776-3618551edd74 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: daf1508c-21c6-4c2b-91a0-3e717092a118 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: c58b6d59-7cb2-478f-9d27-4e70c13f0853 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 866941d2-4c43-4318-8945-46a2adbe895e (service), filesystem_pool: Some(ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bf6599a3-a940-4bd6-8da8-cae73b3b8320, kind: Service { id: 866941d2-4c43-4318-8945-46a2adbe895e }, name: Name("ntp-866941d2-4c43-4318-8945-46a2adbe895e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 183])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7ce38db8-cd11-47e3-9d63-5146bf119be0 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 94845adf-afa8-42f2-a12d-ef9f98d0e9dc (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1f3f1855-29d4-411d-b863-6194d51ea270 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 20059b7d-f93f-429d-b4d4-346565992c31 (service), filesystem_pool: Some(ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 00e155eb-aff1-4251-ac5c-53ab2c5c426c (service), filesystem_pool: Some(ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11032025-02-28T11:07:44.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43154
11042025-02-28T11:07:44.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11052025-02-28T11:07:44.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }
11062025-02-28T11:07:44.026ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11072025-02-28T11:07:44.026ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11082025-02-28T11:07:44.035ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11092025-02-28T11:07:44.035ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11102025-02-28T11:07:44.045ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11112025-02-28T11:07:44.045ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, responder: ... }
11122025-02-28T11:07:44.054ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11132025-02-28T11:07:44.054ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11142025-02-28T11:07:44.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11152025-02-28T11:07:44.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11162025-02-28T11:07:44.069ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11172025-02-28T11:07:44.069ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11182025-02-28T11:07:44.080ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11192025-02-28T11:07:44.080ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, responder: ... }
11202025-02-28T11:07:44.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212025-02-28T11:07:44.089ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
11222025-02-28T11:07:44.090ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
11232025-02-28T11:07:44.090ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
11242025-02-28T11:07:44.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11252025-02-28T11:07:44.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262025-02-28T11:07:44.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272025-02-28T11:07:44.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-02-28T11:07:44.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292025-02-28T11:07:44.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302025-02-28T11:07:44.262ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270 file = illumos-utils/src/zone.rs:325
11312025-02-28T11:07:44.266ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31 file = illumos-utils/src/zone.rs:325
11322025-02-28T11:07:44.271ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0 file = illumos-utils/src/zone.rs:325
11332025-02-28T11:07:44.275ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc file = illumos-utils/src/zone.rs:325
11342025-02-28T11:07:44.279ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c file = illumos-utils/src/zone.rs:325
11352025-02-28T11:07:44.284ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270 file = illumos-utils/src/zone.rs:363
11362025-02-28T11:07:44.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31 file = illumos-utils/src/zone.rs:363
11372025-02-28T11:07:44.294ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0 file = illumos-utils/src/zone.rs:363
11382025-02-28T11:07:44.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc file = illumos-utils/src/zone.rs:363
11392025-02-28T11:07:44.303ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c file = illumos-utils/src/zone.rs:363
11402025-02-28T11:07:47.449ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='20059b7d-f93f-429d-b4d4-346565992c31'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412025-02-28T11:07:47.449ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11422025-02-28T11:07:47.486ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='94845adf-afa8-42f2-a12d-ef9f98d0e9dc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11432025-02-28T11:07:47.486ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11442025-02-28T11:07:47.502ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1f3f1855-29d4-411d-b863-6194d51ea270'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11452025-02-28T11:07:47.502ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11462025-02-28T11:07:47.587ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7ce38db8-cd11-47e3-9d63-5146bf119be0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11472025-02-28T11:07:47.588ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11482025-02-28T11:07:47.609ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='00e155eb-aff1-4251-ac5c-53ab2c5c426c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11492025-02-28T11:07:47.610ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11502025-02-28T11:07:47.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 52.461334ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11512025-02-28T11:07:47.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 47.469982ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11522025-02-28T11:07:47.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 35.011154ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11532025-02-28T11:07:47.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 111.07996ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11542025-02-28T11:07:47.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 117.292898ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11552025-02-28T11:07:47.771ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 118.638174ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11562025-02-28T11:07:47.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 68.364061ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11572025-02-28T11:07:48.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 73.315488ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11582025-02-28T11:07:48.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 212.253878ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11592025-02-28T11:07:48.514ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 174.232609ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11602025-02-28T11:07:48.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 118.340987ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11612025-02-28T11:07:48.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 189.299011ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11622025-02-28T11:07:48.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 128.680503ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11632025-02-28T11:07:48.665ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 568.586443ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11642025-02-28T11:07:48.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 291.393324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11652025-02-28T11:07:48.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 277.729148ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11662025-02-28T11:07:48.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 189.838867ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11672025-02-28T11:07:48.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 544.942989ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11682025-02-28T11:07:48.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 493.230768ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11692025-02-28T11:07:48.989ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 555.749293ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11702025-02-28T11:07:49.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 973.663766ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11712025-02-28T11:07:49.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.054115757s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11722025-02-28T11:07:49.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 1.164443405s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11732025-02-28T11:07:49.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 531.675801ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11742025-02-28T11:07:49.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 742.343215ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11752025-02-28T11:07:49.989ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 1.354984139s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11762025-02-28T11:07:50.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 536.08945ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11772025-02-28T11:07:50.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.33540934s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11782025-02-28T11:07:50.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 581.543941ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11792025-02-28T11:07:50.528ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 1.248595015s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11802025-02-28T11:07:50.574ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 1.278629655s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11812025-02-28T11:07:50.918ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 922.788758ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11822025-02-28T11:07:51.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 1.043366763s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11832025-02-28T11:07:51.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 542.116458ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11842025-02-28T11:07:51.790ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 1.478072323s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11852025-02-28T11:07:51.853ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 571.993671ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11862025-02-28T11:07:51.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 758.1489ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11872025-02-28T11:07:52.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 685.608811ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11882025-02-28T11:07:52.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 944.36925ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11892025-02-28T11:07:52.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 514.323133ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11902025-02-28T11:07:52.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 712.737813ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11912025-02-28T11:07:52.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 578.562712ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11922025-02-28T11:07:52.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 1.298556264s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11932025-02-28T11:07:53.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 723.378964ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11942025-02-28T11:07:53.360ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 1.492997636s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
11952025-02-28T11:07:53.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 1.399921898s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
11962025-02-28T11:07:53.506ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.145967733s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
11972025-02-28T11:07:54.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 606.649799ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
11982025-02-28T11:07:54.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 1.292364648s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
11992025-02-28T11:07:54.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 852.841612ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12002025-02-28T11:07:54.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.421731997s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
12012025-02-28T11:07:54.783ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 1.256966158s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
12022025-02-28T11:07:54.866ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 579.944293ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12032025-02-28T11:07:55.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 666.665083ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12042025-02-28T11:07:55.503ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 695.445806ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12052025-02-28T11:07:55.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 545.026457ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
12062025-02-28T11:07:56.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 873.902429ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
12072025-02-28T11:07:56.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.353100248s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
12082025-02-28T11:07:56.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 1.194606011s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
12092025-02-28T11:07:56.144ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 696.295374ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12102025-02-28T11:07:56.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 684.73509ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12112025-02-28T11:07:56.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 537.84614ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12122025-02-28T11:07:56.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 962.945313ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12132025-02-28T11:07:56.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31") failed: Property not found. retry in 1.352574661s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
12142025-02-28T11:07:57.344ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0") failed: Property not found. retry in 1.417028447s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
12152025-02-28T11:07:57.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c") failed: Property not found. retry in 767.653752ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12162025-02-28T11:07:57.463ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270") failed: Property not found. retry in 1.470816233s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
12172025-02-28T11:07:57.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc") failed: Property not found. retry in 797.529101ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12182025-02-28T11:07:58.959ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_1f3f1855-29d4-411d-b863-6194d51ea270
12192025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_20059b7d-f93f-429d-b4d4-346565992c31
12202025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_7ce38db8-cd11-47e3-9d63-5146bf119be0
12212025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_94845adf-afa8-42f2-a12d-ef9f98d0e9dc
12222025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c
12232025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12242025-02-28T11:07:58.960ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12252025-02-28T11:07:58.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 14905686 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43154 req_id = 753c91bd-0dc8-4893-8a0c-83b04dd080d2 response_code = 204 uri = /omicron-zones
12262025-02-28T11:07:58.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52117
12272025-02-28T11:07:59.026ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 30739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 2b5adbaa-745f-45e4-b908-f70e6249dfb1 response_code = 500 uri = /cockroachdb
12282025-02-28T11:07:59.026ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2b5adbaa-745f-45e4-b908-f70e6249dfb1", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2b5adbaa-745f-45e4-b908-f70e6249dfb1" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 135.616556ms
12292025-02-28T11:07:59.192ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = da99a9af-7a75-4603-96eb-83c4e66f749d response_code = 500 uri = /cockroachdb
12302025-02-28T11:07:59.192ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "da99a9af-7a75-4603-96eb-83c4e66f749d", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "da99a9af-7a75-4603-96eb-83c4e66f749d" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 128.365868ms
12312025-02-28T11:07:59.347ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 0c19e0cf-6f48-4044-90cc-5c8db5faba45 response_code = 500 uri = /cockroachdb
12322025-02-28T11:07:59.347ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0c19e0cf-6f48-4044-90cc-5c8db5faba45", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0c19e0cf-6f48-4044-90cc-5c8db5faba45" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 122.558635ms
12332025-02-28T11:07:59.497ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = d2e0a461-0453-40ba-9584-71ef7a247bec response_code = 500 uri = /cockroachdb
12342025-02-28T11:07:59.497ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d2e0a461-0453-40ba-9584-71ef7a247bec", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d2e0a461-0453-40ba-9584-71ef7a247bec" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 233.155464ms
12352025-02-28T11:07:59.758ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 96b00928-1b1d-46a4-a197-2570d2ad91c7 response_code = 500 uri = /cockroachdb
12362025-02-28T11:07:59.758ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "96b00928-1b1d-46a4-a197-2570d2ad91c7", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "96b00928-1b1d-46a4-a197-2570d2ad91c7" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 205.641721ms
12372025-02-28T11:07:59.995ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 7b92fba7-8790-4245-8d58-ade0447b122e response_code = 500 uri = /cockroachdb
12382025-02-28T11:07:59.995ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7b92fba7-8790-4245-8d58-ade0447b122e", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7b92fba7-8790-4245-8d58-ade0447b122e" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 296.733962ms
12392025-02-28T11:08:00.321ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27755 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 65be1e63-cb58-4d3b-bc57-76a6e9e7b4f7 response_code = 500 uri = /cockroachdb
12402025-02-28T11:08:00.321ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "65be1e63-cb58-4d3b-bc57-76a6e9e7b4f7", "content-length": "124", "date": "Fri, 28 Feb 2025 11:07:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "65be1e63-cb58-4d3b-bc57-76a6e9e7b4f7" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 299.765544ms
12412025-02-28T11:08:00.650ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = c977c3af-27e4-4ee6-b52f-abea5bd5f20d response_code = 500 uri = /cockroachdb
12422025-02-28T11:08:00.650ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c977c3af-27e4-4ee6-b52f-abea5bd5f20d", "content-length": "124", "date": "Fri, 28 Feb 2025 11:08:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c977c3af-27e4-4ee6-b52f-abea5bd5f20d" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 417.664044ms
12432025-02-28T11:08:01.097ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = a010b73a-b020-4d21-98aa-f33f42a61eef response_code = 500 uri = /cockroachdb
12442025-02-28T11:08:01.097ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a010b73a-b020-4d21-98aa-f33f42a61eef", "content-length": "124", "date": "Fri, 28 Feb 2025 11:08:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a010b73a-b020-4d21-98aa-f33f42a61eef" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 326.461715ms
12452025-02-28T11:08:01.453ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 13d16196-74d1-45d2-8ec4-b4c66996a360 response_code = 500 uri = /cockroachdb
12462025-02-28T11:08:01.453ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "13d16196-74d1-45d2-8ec4-b4c66996a360", "content-length": "124", "date": "Fri, 28 Feb 2025 11:08:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "13d16196-74d1-45d2-8ec4-b4c66996a360" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 647.821487ms
12472025-02-28T11:08:02.129ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_00e155eb-aff1-4251-ac5c-53ab2c5c426c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 8c45d236-0073-40bb-b43b-00ddf2a0ebb3 response_code = 500 uri = /cockroachdb
12482025-02-28T11:08:02.130ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8c45d236-0073-40bb-b43b-00ddf2a0ebb3", "content-length": "124", "date": "Fri, 28 Feb 2025 11:08:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8c45d236-0073-40bb-b43b-00ddf2a0ebb3" } file = sled-agent/src/rack_setup/service.rs:1144 retry_after = 701.45295ms
12492025-02-28T11:08:02.865ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3852
12502025-02-28T11:08:15.202ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3870
12512025-02-28T11:08:18.809ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3893
12522025-02-28T11:08:18.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 15979177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:52117 req_id = 12d2a6a2-0e3c-4a15-9c2d-a90a05697de4 response_code = 204 uri = /cockroachdb
12532025-02-28T11:08:18.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46974
12542025-02-28T11:08:18.821ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 998 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46974 req_id = 98cc62e1-eebd-452d-882c-eb93335ff70d response_code = 200 uri = /baseboard
12552025-02-28T11:08:18.942ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: e9dfcf5e-a922-4658-a776-3618551edd74 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: daf1508c-21c6-4c2b-91a0-3e717092a118 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: c58b6d59-7cb2-478f-9d27-4e70c13f0853 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 866941d2-4c43-4318-8945-46a2adbe895e (service), filesystem_pool: Some(ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bf6599a3-a940-4bd6-8da8-cae73b3b8320, kind: Service { id: 866941d2-4c43-4318-8945-46a2adbe895e }, name: Name("ntp-866941d2-4c43-4318-8945-46a2adbe895e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 183])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 7ce38db8-cd11-47e3-9d63-5146bf119be0 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 94845adf-afa8-42f2-a12d-ef9f98d0e9dc (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1f3f1855-29d4-411d-b863-6194d51ea270 (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 20059b7d-f93f-429d-b4d4-346565992c31 (service), filesystem_pool: Some(ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 00e155eb-aff1-4251-ac5c-53ab2c5c426c (service), filesystem_pool: Some(ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2cd949b0-a160-497e-a9d3-708f380c3425 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 441521c3-bf8d-4bb0-a351-260cd1158738 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 (service), filesystem_pool: Some(ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 (service), filesystem_pool: Some(ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb (service), filesystem_pool: Some(ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 59e12d21-f0a8-4840-9b1a-87533ec59eae (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: c86b5cc9-13b1-47e2-acd9-16cfdc736c76 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 07b911bb-6b4e-4c0e-81a7-f54569d3d7bc (service), filesystem_pool: Some(ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: e1281558-8e03-438c-bd13-a2f9aeec9ead (service), filesystem_pool: Some(ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 35ed521f-95e6-4bfa-9190-054c7e2cf3be (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 36f36eb8-3337-4094-bdbc-48d1ac625e53 (service), filesystem_pool: Some(ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a4f87105-6760-4ce8-8f92-151b210d70e9 (service), filesystem_pool: Some(ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 440f542b-3802-4ba7-9519-e88b46517bcf (service), filesystem_pool: Some(ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 40169119-1b0f-4fa9-9f67-d81adb05f1ae (service), filesystem_pool: Some(ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: baf9fba6-996e-4392-a14e-4a65abe5328b (service), filesystem_pool: Some(ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 40b5a3e7-e7cd-4dc3-befd-9ce288b420b3 (service), filesystem_pool: Some(ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 4ed74b9e-a84f-40e7-ad4f-e512c2fd6555 (service), filesystem_pool: Some(ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2177a2fb-c2f9-442f-990d-98250c85bf31 (service), filesystem_pool: Some(ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: fe98b765-81b6-4cd7-bebc-2170b1503992 (service), filesystem_pool: Some(ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12562025-02-28T11:08:18.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53558
12572025-02-28T11:08:18.947ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12582025-02-28T11:08:18.947ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: InternalDns }, responder: ... }
12592025-02-28T11:08:18.962ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12602025-02-28T11:08:18.962ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12612025-02-28T11:08:18.971ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12622025-02-28T11:08:18.971ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12632025-02-28T11:08:18.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12642025-02-28T11:08:18.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Cockroach }, responder: ... }
12652025-02-28T11:08:18.992ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12662025-02-28T11:08:18.993ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12672025-02-28T11:08:19.003ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12682025-02-28T11:08:19.004ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12692025-02-28T11:08:19.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12702025-02-28T11:08:19.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12712025-02-28T11:08:19.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12722025-02-28T11:08:19.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12732025-02-28T11:08:19.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12742025-02-28T11:08:19.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12752025-02-28T11:08:19.048ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12762025-02-28T11:08:19.049ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12772025-02-28T11:08:19.060ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12782025-02-28T11:08:19.060ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12792025-02-28T11:08:19.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12802025-02-28T11:08:19.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, kind: Crucible }, responder: ... }
12812025-02-28T11:08:19.081ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12822025-02-28T11:08:19.081ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, kind: Crucible }, responder: ... }
12832025-02-28T11:08:19.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12842025-02-28T11:08:19.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, kind: Crucible }, responder: ... }
12852025-02-28T11:08:19.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12862025-02-28T11:08:19.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12872025-02-28T11:08:19.113ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12882025-02-28T11:08:19.113ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, kind: Crucible }, responder: ... }
12892025-02-28T11:08:19.121ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12902025-02-28T11:08:19.121ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, kind: Crucible }, responder: ... }
12912025-02-28T11:08:19.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12922025-02-28T11:08:19.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, kind: Crucible }, responder: ... }
12932025-02-28T11:08:19.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12942025-02-28T11:08:19.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, kind: Crucible }, responder: ... }
12952025-02-28T11:08:19.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12962025-02-28T11:08:19.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, kind: Crucible }, responder: ... }
12972025-02-28T11:08:19.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12982025-02-28T11:08:19.160ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
12992025-02-28T11:08:19.161ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
13002025-02-28T11:08:19.162ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4956 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
13012025-02-28T11:08:19.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13022025-02-28T11:08:19.265ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13032025-02-28T11:08:19.304ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13042025-02-28T11:08:19.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13052025-02-28T11:08:19.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13062025-02-28T11:08:19.344ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13072025-02-28T11:08:19.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13082025-02-28T11:08:19.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13092025-02-28T11:08:19.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13102025-02-28T11:08:19.344ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13112025-02-28T11:08:19.346ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13122025-02-28T11:08:19.483ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13132025-02-28T11:08:19.547ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13142025-02-28T11:08:19.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13152025-02-28T11:08:19.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13162025-02-28T11:08:19.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13172025-02-28T11:08:19.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13182025-02-28T11:08:19.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13192025-02-28T11:08:19.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13202025-02-28T11:08:19.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13212025-02-28T11:08:19.561ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3 file = illumos-utils/src/zone.rs:325
13222025-02-28T11:08:19.567ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76 file = illumos-utils/src/zone.rs:325
13232025-02-28T11:08:19.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be file = illumos-utils/src/zone.rs:325
13242025-02-28T11:08:19.577ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae file = illumos-utils/src/zone.rs:325
13252025-02-28T11:08:19.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9 file = illumos-utils/src/zone.rs:325
13262025-02-28T11:08:19.588ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b file = illumos-utils/src/zone.rs:325
13272025-02-28T11:08:19.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc file = illumos-utils/src/zone.rs:325
13282025-02-28T11:08:19.736ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3 file = illumos-utils/src/zone.rs:363
13292025-02-28T11:08:19.741ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76 file = illumos-utils/src/zone.rs:363
13302025-02-28T11:08:19.746ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be file = illumos-utils/src/zone.rs:363
13312025-02-28T11:08:19.750ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae file = illumos-utils/src/zone.rs:363
13322025-02-28T11:08:19.754ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9 file = illumos-utils/src/zone.rs:363
13332025-02-28T11:08:19.759ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b file = illumos-utils/src/zone.rs:363
13342025-02-28T11:08:19.765ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc file = illumos-utils/src/zone.rs:363
13352025-02-28T11:08:19.770ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53 file = illumos-utils/src/zone.rs:325
13362025-02-28T11:08:19.775ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555 file = illumos-utils/src/zone.rs:325
13372025-02-28T11:08:19.782ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31 file = illumos-utils/src/zone.rs:325
13382025-02-28T11:08:19.788ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae file = illumos-utils/src/zone.rs:325
13392025-02-28T11:08:19.794ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992 file = illumos-utils/src/zone.rs:325
13402025-02-28T11:08:19.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead file = illumos-utils/src/zone.rs:325
13412025-02-28T11:08:19.807ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf file = illumos-utils/src/zone.rs:325
13422025-02-28T11:08:19.872ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13432025-02-28T11:08:19.928ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13442025-02-28T11:08:19.928ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53 file = illumos-utils/src/zone.rs:363
13452025-02-28T11:08:19.936ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555 file = illumos-utils/src/zone.rs:363
13462025-02-28T11:08:19.942ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31 file = illumos-utils/src/zone.rs:363
13472025-02-28T11:08:19.949ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae file = illumos-utils/src/zone.rs:363
13482025-02-28T11:08:19.956ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992 file = illumos-utils/src/zone.rs:363
13492025-02-28T11:08:19.966ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead file = illumos-utils/src/zone.rs:363
13502025-02-28T11:08:19.973ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf file = illumos-utils/src/zone.rs:363
13512025-02-28T11:08:20.032ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13522025-02-28T11:08:20.098ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13532025-02-28T11:08:20.158ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13542025-02-28T11:08:20.170ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13552025-02-28T11:08:20.170ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13562025-02-28T11:08:20.233ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 236, 36]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13572025-02-28T11:08:20.233ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
13582025-02-28T11:08:20.237ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13592025-02-28T11:08:20.237ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13602025-02-28T11:08:20.292ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 128, 84]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13612025-02-28T11:08:20.292ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = external_dns
13622025-02-28T11:08:20.293ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13632025-02-28T11:08:20.293ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13642025-02-28T11:08:20.347ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 224, 14]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13652025-02-28T11:08:20.347ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13662025-02-28T11:08:20.348ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13672025-02-28T11:08:20.348ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13682025-02-28T11:08:20.402ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 177, 246]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13692025-02-28T11:08:20.402ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13702025-02-28T11:08:20.405ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13712025-02-28T11:08:20.405ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13722025-02-28T11:08:20.461ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 140, 54]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13732025-02-28T11:08:20.461ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1358 zone_type = nexus
13742025-02-28T11:08:20.462ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13752025-02-28T11:08:20.462ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13762025-02-28T11:08:20.462ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13772025-02-28T11:08:20.462ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13782025-02-28T11:08:20.464ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13792025-02-28T11:08:20.464ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13802025-02-28T11:08:20.486ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13812025-02-28T11:08:20.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13822025-02-28T11:08:20.542ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13832025-02-28T11:08:20.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13842025-02-28T11:08:20.546ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13852025-02-28T11:08:20.546ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13862025-02-28T11:08:20.546ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13872025-02-28T11:08:20.546ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13882025-02-28T11:08:20.546ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13892025-02-28T11:08:20.607ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13902025-02-28T11:08:20.610ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13912025-02-28T11:08:20.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13922025-02-28T11:08:20.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13932025-02-28T11:08:20.615ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13942025-02-28T11:08:20.672ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425 file = illumos-utils/src/zone.rs:325
13952025-02-28T11:08:20.683ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738 file = illumos-utils/src/zone.rs:325
13962025-02-28T11:08:20.822ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb file = illumos-utils/src/zone.rs:325
13972025-02-28T11:08:20.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425 file = illumos-utils/src/zone.rs:363
13982025-02-28T11:08:20.843ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738 file = illumos-utils/src/zone.rs:363
13992025-02-28T11:08:20.851ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497 file = illumos-utils/src/zone.rs:325
14002025-02-28T11:08:20.860ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97 file = illumos-utils/src/zone.rs:325
14012025-02-28T11:08:20.871ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb file = illumos-utils/src/zone.rs:363
14022025-02-28T11:08:20.895ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497 file = illumos-utils/src/zone.rs:363
14032025-02-28T11:08:20.903ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97 file = illumos-utils/src/zone.rs:363
14042025-02-28T11:08:32.535ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052025-02-28T11:08:32.746ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14062025-02-28T11:08:33.750ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='05d7bc33-92c6-4e96-998d-f50ee9712251'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14072025-02-28T11:08:33.762ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14082025-02-28T11:08:33.800ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3eced58b-69b0-4a58-a7df-32c6431e950a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f045a75a-730d-4420-855d-721a3ac2717c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14092025-02-28T11:08:33.812ZINFOSledAgent (ServiceManager): Booting oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14102025-02-28T11:08:33.836ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='54c6c858-fb9a-455c-9375-6cf277e0f8c0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14112025-02-28T11:08:33.861ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fa8e53ef-f341-4626-a351-436b60107fd4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='20a8c1d5-13a3-4dd0-bbc4-782a1bd78248'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14122025-02-28T11:08:33.885ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='24a6b426-b095-49ff-a804-e187f41021f6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14132025-02-28T11:08:33.961ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dce85aac-5feb-46f0-9268-e34ae310482f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cb5ff325-8c7b-4301-a951-83673e07673b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14142025-02-28T11:08:33.961ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14152025-02-28T11:08:34.035ZINFOSledAgent (ServiceManager): Booting oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14162025-02-28T11:08:34.091ZINFOSledAgent (ServiceManager): Booting oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14172025-02-28T11:08:34.104ZINFOSledAgent (ServiceManager): Booting oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14182025-02-28T11:08:34.334ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 41.153957397s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
14192025-02-28T11:08:35.432ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='24504072-41ee-4a29-9927-7933c310d5d6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14202025-02-28T11:08:35.454ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212025-02-28T11:08:35.454ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14222025-02-28T11:08:35.512ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14232025-02-28T11:08:37.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 56.212316ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14242025-02-28T11:08:37.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 27.527333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14252025-02-28T11:08:37.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 44.11036ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14262025-02-28T11:08:37.357ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14272025-02-28T11:08:37.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 25.258847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14282025-02-28T11:08:37.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 71.146066ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14292025-02-28T11:08:37.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 30.031117ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14302025-02-28T11:08:37.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 66.185777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14312025-02-28T11:08:37.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 69.171136ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14322025-02-28T11:08:37.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 72.318077ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14332025-02-28T11:08:37.414ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14342025-02-28T11:08:37.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 140.699685ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14352025-02-28T11:08:37.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 76.441216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14362025-02-28T11:08:37.444ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 88.948697ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14372025-02-28T11:08:37.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 119.680314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14382025-02-28T11:08:37.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 114.812702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14392025-02-28T11:08:37.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 50.502022ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14402025-02-28T11:08:37.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 74.089721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14412025-02-28T11:08:37.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 127.102369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14422025-02-28T11:08:37.501ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 69.669236ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14432025-02-28T11:08:37.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 142.77885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14442025-02-28T11:08:37.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 232.419701ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14452025-02-28T11:08:37.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 208.675915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14462025-02-28T11:08:37.570ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 122.362995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14472025-02-28T11:08:37.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 146.478438ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14482025-02-28T11:08:37.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 230.261189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14492025-02-28T11:08:37.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 159.586668ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14502025-02-28T11:08:37.664ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 264.611765ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14512025-02-28T11:08:37.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 41.218333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14522025-02-28T11:08:37.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 209.419887ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14532025-02-28T11:08:37.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 369.786637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14542025-02-28T11:08:37.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 400.091235ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14552025-02-28T11:08:37.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 138.002457ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14562025-02-28T11:08:37.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 451.459414ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14572025-02-28T11:08:37.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 525.000566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14582025-02-28T11:08:37.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 581.160646ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14592025-02-28T11:08:37.786ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 504.022268ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14602025-02-28T11:08:37.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 534.208462ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14612025-02-28T11:08:37.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 112.111379ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14622025-02-28T11:08:37.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 585.86292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14632025-02-28T11:08:37.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 471.473629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14642025-02-28T11:08:37.970ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='71587508-7544-4274-a735-cdb16fbcf96d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14652025-02-28T11:08:37.970ZINFOSledAgent (ServiceManager): Booting oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14662025-02-28T11:08:38.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 219.098098ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14672025-02-28T11:08:38.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 530.524785ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14682025-02-28T11:08:38.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_57c9df87-515e-406c-b81d-f5a8f2f31360/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aeccd053-6bef-4f7e-86dd-2bfac6f37ff4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14692025-02-28T11:08:38.083ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
14702025-02-28T11:08:38.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 520.758199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14712025-02-28T11:08:38.207ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 646.450331ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14722025-02-28T11:08:38.219ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 65.722292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14732025-02-28T11:08:38.232ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 643.037576ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14742025-02-28T11:08:38.295ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 99.109182ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14752025-02-28T11:08:38.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 557.253954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14762025-02-28T11:08:38.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 502.445123ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14772025-02-28T11:08:38.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 46.697257ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
14782025-02-28T11:08:38.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 529.463145ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14792025-02-28T11:08:38.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.040445483s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
14802025-02-28T11:08:38.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 80.787279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
14812025-02-28T11:08:38.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 161.140652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14822025-02-28T11:08:38.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.120016074s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
14832025-02-28T11:08:38.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 196.280911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
14842025-02-28T11:08:38.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 448.850777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
14852025-02-28T11:08:38.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 371.842476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14862025-02-28T11:08:38.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 550.521448ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
14872025-02-28T11:08:38.660ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 907.162147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
14882025-02-28T11:08:38.661ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14892025-02-28T11:08:38.661ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
14902025-02-28T11:08:38.730ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 494.00338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
14912025-02-28T11:08:38.793ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14922025-02-28T11:08:38.794ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
14932025-02-28T11:08:38.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 676.935767ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
14942025-02-28T11:08:38.867ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 600.771806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
14952025-02-28T11:08:38.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.348278005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
14962025-02-28T11:08:38.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.034811001s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
14972025-02-28T11:08:38.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 729.77295ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
14982025-02-28T11:08:38.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 911.53502ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
14992025-02-28T11:08:38.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.377151579s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15002025-02-28T11:08:38.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 55.949785ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15012025-02-28T11:08:39.046ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 101.922ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15022025-02-28T11:08:39.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 46.875221ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15032025-02-28T11:08:39.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 148.67631ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15042025-02-28T11:08:39.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 270.611634ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15052025-02-28T11:08:39.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.33731507s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15062025-02-28T11:08:39.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 926.08456ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15072025-02-28T11:08:39.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 248.290296ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15082025-02-28T11:08:39.435ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.309133788s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15092025-02-28T11:08:39.444ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 241.255673ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15102025-02-28T11:08:39.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 738.892648ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15112025-02-28T11:08:39.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 934.292553ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15122025-02-28T11:08:39.544ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 598.738772ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15132025-02-28T11:08:39.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.175396418s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
15142025-02-28T11:08:39.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.398983075s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
15152025-02-28T11:08:39.645ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='59e12d21-f0a8-4840-9b1a-87533ec59eae'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15162025-02-28T11:08:39.645ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15172025-02-28T11:08:39.658ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.128370391s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
15182025-02-28T11:08:39.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 969.563974ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15192025-02-28T11:08:39.800ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 28.243987ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15202025-02-28T11:08:39.837ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 115.237821ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15212025-02-28T11:08:39.882ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 727.963967ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15222025-02-28T11:08:39.935ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.274075324s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
15232025-02-28T11:08:39.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 258.402197ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15242025-02-28T11:08:40.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 403.906256ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15252025-02-28T11:08:40.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.458834426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15262025-02-28T11:08:40.226ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.4640794s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15272025-02-28T11:08:40.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 428.040405ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15282025-02-28T11:08:40.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 908.374247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
15292025-02-28T11:08:40.358ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.383320237s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15302025-02-28T11:08:40.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.262956118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15312025-02-28T11:08:40.537ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 768.490197ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15322025-02-28T11:08:40.568ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 873.957396ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15332025-02-28T11:08:40.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 506.607519ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15342025-02-28T11:08:40.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 540.448608ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15352025-02-28T11:08:40.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.352453648s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15362025-02-28T11:08:40.740ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.280091278s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
15372025-02-28T11:08:40.754ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.106435457s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15382025-02-28T11:08:40.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 875.803777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
15392025-02-28T11:08:40.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.499294145s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
15402025-02-28T11:08:41.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 697.082525ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15412025-02-28T11:08:41.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 969.872815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
15422025-02-28T11:08:41.218ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.37788827s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
15432025-02-28T11:08:41.227ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 579.921624ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15442025-02-28T11:08:41.316ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 637.111337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15452025-02-28T11:08:41.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 980.479516ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15462025-02-28T11:08:41.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 534.327566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15472025-02-28T11:08:41.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 867.042853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
15482025-02-28T11:08:41.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 960.06721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15492025-02-28T11:08:41.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.352786571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15502025-02-28T11:08:41.756ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.107415379s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15512025-02-28T11:08:41.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 792.974527ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15522025-02-28T11:08:41.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 882.772239ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15532025-02-28T11:08:41.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 941.336313ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15542025-02-28T11:08:41.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 868.799064ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15552025-02-28T11:08:42.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 596.652728ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
15562025-02-28T11:08:42.049ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 789.975763ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15572025-02-28T11:08:42.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.271460821s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
15582025-02-28T11:08:42.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 568.976275ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15592025-02-28T11:08:42.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.445143446s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15602025-02-28T11:08:42.560ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.496982761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
15612025-02-28T11:08:42.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.49659027s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
15622025-02-28T11:08:42.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.290462635s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
15632025-02-28T11:08:42.628ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.067336946s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15642025-02-28T11:08:42.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.184722s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
15652025-02-28T11:08:42.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 650.507281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15662025-02-28T11:08:42.733ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.21738418s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15672025-02-28T11:08:42.763ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.363475942s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15682025-02-28T11:08:42.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 813.625858ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15692025-02-28T11:08:42.840ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 930.172042ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15702025-02-28T11:08:42.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 536.324587ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15712025-02-28T11:08:42.874ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 680.020065ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15722025-02-28T11:08:43.115ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 862.201005ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15732025-02-28T11:08:43.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 945.79298ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15742025-02-28T11:08:43.396ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 669.441943ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15752025-02-28T11:08:43.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 760.700785ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
15762025-02-28T11:08:43.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.454523192s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15772025-02-28T11:08:43.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.319463222s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15782025-02-28T11:08:43.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 741.634395ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15792025-02-28T11:08:43.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.30218193s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
15802025-02-28T11:08:43.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.36363617s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
15812025-02-28T11:08:43.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.170253727s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15822025-02-28T11:08:43.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.002787915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
15832025-02-28T11:08:43.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 895.801854ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15842025-02-28T11:08:43.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.065049836s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15852025-02-28T11:08:44.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.196632556s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
15862025-02-28T11:08:44.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 969.541509ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15872025-02-28T11:08:44.084ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.093809757s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
15882025-02-28T11:08:44.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.060668307s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
15892025-02-28T11:08:44.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.432817799s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
15902025-02-28T11:08:44.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 856.798396ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
15912025-02-28T11:08:44.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 913.548086ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
15922025-02-28T11:08:44.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 671.04326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
15932025-02-28T11:08:44.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.043988673s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
15942025-02-28T11:08:44.974ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 768.33367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
15952025-02-28T11:08:45.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 817.92893ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
15962025-02-28T11:08:45.056ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.041988062s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
15972025-02-28T11:08:45.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.246756425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
15982025-02-28T11:08:45.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 768.128808ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
15992025-02-28T11:08:45.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 627.373428ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16002025-02-28T11:08:45.157ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 967.567719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
16012025-02-28T11:08:45.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 597.03911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16022025-02-28T11:08:45.207ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 669.155302ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
16032025-02-28T11:08:45.215ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.392299408s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
16042025-02-28T11:08:45.274ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.103878837s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
16052025-02-28T11:08:45.382ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.052705894s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
16062025-02-28T11:08:45.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 648.46446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
16072025-02-28T11:08:45.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 972.911323ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
16082025-02-28T11:08:45.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.257130387s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16092025-02-28T11:08:45.752ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.367191916s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
16102025-02-28T11:08:45.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.472421179s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16112025-02-28T11:08:45.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 652.494037ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
16122025-02-28T11:08:45.873ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 752.179587ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
16132025-02-28T11:08:45.873ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16142025-02-28T11:08:45.874ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16152025-02-28T11:08:45.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.167824125s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
16162025-02-28T11:08:45.891ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16172025-02-28T11:08:45.891ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16182025-02-28T11:08:45.891ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16192025-02-28T11:08:45.897ZINFOSledAgent (ServiceManager): Booting oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16202025-02-28T11:08:45.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.124990679s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
16212025-02-28T11:08:46.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 44.98257ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16222025-02-28T11:08:46.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 73.616775ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16232025-02-28T11:08:46.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 35.667399ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16242025-02-28T11:08:46.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 780.594732ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
16252025-02-28T11:08:46.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 102.010934ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16262025-02-28T11:08:46.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.152762303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
16272025-02-28T11:08:46.147ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 93.179701ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16282025-02-28T11:08:46.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 63.098678ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16292025-02-28T11:08:46.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.073569042s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
16302025-02-28T11:08:46.249ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 188.586777ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16312025-02-28T11:08:46.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 274.310141ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16322025-02-28T11:08:46.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 116.968144ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16332025-02-28T11:08:46.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.498697638s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
16342025-02-28T11:08:46.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.409327572s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
16352025-02-28T11:08:46.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 520.168033ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16362025-02-28T11:08:46.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.491538701s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
16372025-02-28T11:08:46.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 560.839791ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16382025-02-28T11:08:46.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.042019679s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
16392025-02-28T11:08:46.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 308.704401ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16402025-02-28T11:08:46.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.459132788s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
16412025-02-28T11:08:46.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 807.545554ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
16422025-02-28T11:08:46.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.432550962s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
16432025-02-28T11:08:46.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 532.253032ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16442025-02-28T11:08:46.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 557.816987ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
16452025-02-28T11:08:46.966ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 798.79759ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16462025-02-28T11:08:47.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 610.103474ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16472025-02-28T11:08:47.027ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 566.106319ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16482025-02-28T11:08:47.071ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 878.361908ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
16492025-02-28T11:08:47.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 983.301473ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
16502025-02-28T11:08:47.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 876.446914ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
16512025-02-28T11:08:47.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 531.593706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16522025-02-28T11:08:47.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.347708607s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
16532025-02-28T11:08:47.329ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.415982786s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
16542025-02-28T11:08:47.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.360254787s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16552025-02-28T11:08:47.460ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 553.568528ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
16562025-02-28T11:08:47.470ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 686.308923ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
16572025-02-28T11:08:47.579ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 704.418416ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
16582025-02-28T11:08:47.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 687.95934ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16592025-02-28T11:08:47.620ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.109014259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16602025-02-28T11:08:47.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 576.232041ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16612025-02-28T11:08:47.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.322033621s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
16622025-02-28T11:08:47.822ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 978.814786ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16632025-02-28T11:08:47.832ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.053909439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
16642025-02-28T11:08:47.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 934.410948ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
16652025-02-28T11:08:47.961ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 575.717506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
16662025-02-28T11:08:48.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.202422181s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
16672025-02-28T11:08:48.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.478549172s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
16682025-02-28T11:08:48.104ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 851.119984ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
16692025-02-28T11:08:48.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.095543148s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
16702025-02-28T11:08:48.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.386167413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
16712025-02-28T11:08:48.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.303376916s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
16722025-02-28T11:08:48.296ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 766.144857ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
16732025-02-28T11:08:48.309ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 790.637338ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16742025-02-28T11:08:48.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 826.981955ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16752025-02-28T11:08:48.550ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.374734919s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
16762025-02-28T11:08:48.669ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.165240711s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
16772025-02-28T11:08:48.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 933.159728ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16782025-02-28T11:08:48.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 669.543354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
16792025-02-28T11:08:48.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.397772657s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
16802025-02-28T11:08:48.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 882.057773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16812025-02-28T11:08:48.897ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.261486717s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
16822025-02-28T11:08:48.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.172598819s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
16832025-02-28T11:08:48.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 892.541889ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
16842025-02-28T11:08:48.972ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53240
16852025-02-28T11:08:48.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3741 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53240 req_id = 10d3a571-0117-44d6-b503-f3c675fbaf19 response_code = 200 uri = /baseboard
16862025-02-28T11:08:49.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 1.385287741s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
16872025-02-28T11:08:49.116ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 1.241307074s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
16882025-02-28T11:08:49.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.171648907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
16892025-02-28T11:08:49.212ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 568.277586ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16902025-02-28T11:08:49.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 586.726435ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
16912025-02-28T11:08:49.253ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.382984701s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
16922025-02-28T11:08:49.444ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 525.804888ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
16932025-02-28T11:08:49.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.335771507s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
16942025-02-28T11:08:49.529ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.067094006s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
16952025-02-28T11:08:49.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 585.007556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
16962025-02-28T11:08:49.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.331782882s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
16972025-02-28T11:08:49.712ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.488831208s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
16982025-02-28T11:08:49.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 698.052577ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
16992025-02-28T11:08:49.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.2318517s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
17002025-02-28T11:08:49.847ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 937.753807ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17012025-02-28T11:08:49.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.22379431s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
17022025-02-28T11:08:49.938ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.140605576s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
17032025-02-28T11:08:49.981ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 547.6644ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
17042025-02-28T11:08:50.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.464777775s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
17052025-02-28T11:08:50.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.243774165s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17062025-02-28T11:08:50.172ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.364550177s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17072025-02-28T11:08:50.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.078173885s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
17082025-02-28T11:08:50.279ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
17092025-02-28T11:08:50.279ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76 zone file = illumos-utils/src/running_zone.rs:489 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17102025-02-28T11:08:50.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.403968148s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
17112025-02-28T11:08:50.371ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 1.279710656s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17122025-02-28T11:08:50.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 898.542582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
17132025-02-28T11:08:50.481ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 44.577225ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17142025-02-28T11:08:50.499ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 635.089022ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17152025-02-28T11:08:50.534ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 67.473779ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17162025-02-28T11:08:50.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.364939497s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
17172025-02-28T11:08:50.622ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.025908178s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
17182025-02-28T11:08:50.649ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 143.967103ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17192025-02-28T11:08:50.666ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.347242464s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
17202025-02-28T11:08:50.802ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 714.663998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17212025-02-28T11:08:50.821ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 270.528942ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17222025-02-28T11:08:50.843ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 524.626026ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
17232025-02-28T11:08:51.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 834.170447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
17242025-02-28T11:08:51.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 504.655464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
17252025-02-28T11:08:51.088ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.344929175s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
17262025-02-28T11:08:51.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 654.5144ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17272025-02-28T11:08:51.111ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.442980774s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
17282025-02-28T11:08:51.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 775.077425ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17292025-02-28T11:08:51.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.497935358s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
17302025-02-28T11:08:51.286ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 619.983156ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
17312025-02-28T11:08:51.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.074003713s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
17322025-02-28T11:08:51.412ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 652.085565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17332025-02-28T11:08:51.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 969.307056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
17342025-02-28T11:08:51.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 563.205277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17352025-02-28T11:08:51.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 890.558618ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17362025-02-28T11:08:51.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 851.786912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
17372025-02-28T11:08:51.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.196092621s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
17382025-02-28T11:08:51.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 966.915085ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
17392025-02-28T11:08:51.676ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 1.130419159s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17402025-02-28T11:08:51.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 590.678004ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
17412025-02-28T11:08:51.771ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.015548083s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17422025-02-28T11:08:51.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.28401818s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
17432025-02-28T11:08:51.919ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.204547919s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
17442025-02-28T11:08:51.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.349673185s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
17452025-02-28T11:08:51.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 1.237571487s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17462025-02-28T11:08:52.031ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 593.901029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
17472025-02-28T11:08:52.077ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 641.670857ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17482025-02-28T11:08:52.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.399931832s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17492025-02-28T11:08:52.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 573.588914ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
17502025-02-28T11:08:52.409ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 914.830507ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
17512025-02-28T11:08:52.443ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 612.092647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
17522025-02-28T11:08:52.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 556.442537ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17532025-02-28T11:08:52.469ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.229509384s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
17542025-02-28T11:08:52.484ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.387085758s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
17552025-02-28T11:08:52.572ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.273472004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
17562025-02-28T11:08:52.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 1.049083616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
17572025-02-28T11:08:52.657ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 1.165543459s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
17582025-02-28T11:08:52.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead") failed: Property not found. retry in 1.290553268s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
17592025-02-28T11:08:52.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 627.953031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17602025-02-28T11:08:52.801ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.195300512s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17612025-02-28T11:08:52.813ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 638.222492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
17622025-02-28T11:08:52.825ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 1.023499527s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17632025-02-28T11:08:52.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae") failed: Property not found. retry in 1.329470147s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
17642025-02-28T11:08:53.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 682.814172ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17652025-02-28T11:08:53.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 1.02658657s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
17662025-02-28T11:08:53.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.181939871s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
17672025-02-28T11:08:53.176ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555") failed: Property not found. retry in 1.374396877s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
17682025-02-28T11:08:53.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 695.587144ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17692025-02-28T11:08:53.294ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53") failed: Property not found. retry in 1.369713184s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
17702025-02-28T11:08:53.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 784.96855ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
17712025-02-28T11:08:53.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be") failed: Property not found. retry in 1.416427801s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17722025-02-28T11:08:53.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc") failed: Property not found. retry in 1.095745155s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
17732025-02-28T11:08:53.518ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b") failed: Property not found. retry in 1.317429911s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17742025-02-28T11:08:53.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3") failed: Property not found. retry in 571.290388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
17752025-02-28T11:08:53.714ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf") failed: Property not found. retry in 1.208759394s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
17762025-02-28T11:08:53.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae") failed: Property not found. retry in 1.38453288s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17772025-02-28T11:08:53.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738") failed: Property not found. retry in 732.525512ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
17782025-02-28T11:08:53.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9") failed: Property not found. retry in 1.405222656s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
17792025-02-28T11:08:53.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 1.173190242s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17802025-02-28T11:08:53.881ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425") failed: Property not found. retry in 1.055854259s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
17812025-02-28T11:08:53.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 673.452804ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17822025-02-28T11:08:54.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.206317949s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17832025-02-28T11:08:54.116ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31") failed: Property not found. retry in 766.190828ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
17842025-02-28T11:08:54.140ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992") failed: Property not found. retry in 731.152664ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
17852025-02-28T11:08:54.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97") failed: Property not found. retry in 1.148572233s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
17862025-02-28T11:08:54.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497") failed: Property not found. retry in 1.08357792s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
17872025-02-28T11:08:55.074ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb") failed: Property not found. retry in 772.57276ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17882025-02-28T11:08:55.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.282126584s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17892025-02-28T11:08:56.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.126018709s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17902025-02-28T11:08:57.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76") failed: Property not found. retry in 1.296707019s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17912025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_d9f8d88d-6bf3-4106-b343-223cfff34ebb
17922025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_40b5a3e7-e7cd-4dc3-befd-9ce288b420b3
17932025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_clickhouse_c86b5cc9-13b1-47e2-acd9-16cfdc736c76
17942025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_2cd949b0-a160-497e-a9d3-708f380c3425
17952025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_35ed521f-95e6-4bfa-9190-054c7e2cf3be
17962025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_oximeter_59e12d21-f0a8-4840-9b1a-87533ec59eae
17972025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_a4f87105-6760-4ce8-8f92-151b210d70e9
17982025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_baf9fba6-996e-4392-a14e-4a65abe5328b
17992025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_external_dns_441521c3-bf8d-4bb0-a351-260cd1158738
18002025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_07b911bb-6b4e-4c0e-81a7-f54569d3d7bc
18012025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_a49a6ffa-af87-4978-97cd-b29e51ec9497
18022025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_36f36eb8-3337-4094-bdbc-48d1ac625e53
18032025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_4ed74b9e-a84f-40e7-ad4f-e512c2fd6555
18042025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_2177a2fb-c2f9-442f-990d-98250c85bf31
18052025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_40169119-1b0f-4fa9-9f67-d81adb05f1ae
18062025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_fe98b765-81b6-4cd7-bebc-2170b1503992
18072025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_nexus_549db258-8cd5-4bc5-bd79-0f3216a4cc97
18082025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_pantry_e1281558-8e03-438c-bd13-a2f9aeec9ead
18092025-02-28T11:08:59.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3415 zone = oxz_crucible_440f542b-3802-4ba7-9519-e88b46517bcf
18102025-02-28T11:08:59.043ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18112025-02-28T11:08:59.046ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18122025-02-28T11:08:59.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40102665 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53558 req_id = d2eea36c-fa2e-4353-b47e-e51ceae510e0 response_code = 204 uri = /omicron-zones
18132025-02-28T11:08:59.065ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1401
18142025-02-28T11:08:59.080ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18152025-02-28T11:08:59.083ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
18162025-02-28T11:08:59.129ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1003
18172025-02-28T11:08:59.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18182025-02-28T11:08:59.205ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18192025-02-28T11:08:59.304ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18202025-02-28T11:08:59.393ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18212025-02-28T11:08:59.582ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18222025-02-28T11:08:59.801ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18232025-02-28T11:08:59.949ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18242025-02-28T11:09:00.102ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18252025-02-28T11:09:00.498ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18262025-02-28T11:09:00.951ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18272025-02-28T11:09:01.402ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18282025-02-28T11:09:01.715ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/3639df61-b683-4f88-93e4-a3de5b0778af/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1065
18292025-02-28T11:09:02.941ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "69e93377-569d-4eff-a2bf-73c0f284fb38", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"3639df61-b683-4f88-93e4-a3de5b0778af\"", request_id: "69e93377-569d-4eff-a2bf-73c0f284fb38" } file = sled-agent/src/rack_setup/service.rs:1065
18302025-02-28T11:09:03.944ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a83bbc86-4ad5-43db-be6f-d0f1843685ca", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"3639df61-b683-4f88-93e4-a3de5b0778af\"", request_id: "a83bbc86-4ad5-43db-be6f-d0f1843685ca" } file = sled-agent/src/rack_setup/service.rs:1065
18312025-02-28T11:09:06.146ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "768484c9-6622-46ad-9047-359694c8a6ce", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"586e5b1c-fe84-4966-a99c-108aa56b2c5f\"", request_id: "768484c9-6622-46ad-9047-359694c8a6ce" } file = sled-agent/src/rack_setup/service.rs:1065
18322025-02-28T11:09:08.050ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "523d95d8-c386-426f-a898-6e80cfbacb6d", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"586e5b1c-fe84-4966-a99c-108aa56b2c5f\"", request_id: "523d95d8-c386-426f-a898-6e80cfbacb6d" } file = sled-agent/src/rack_setup/service.rs:1065
18332025-02-28T11:09:10.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ee6b1b8f-093c-42a2-9bdd-b1ba379b7bfc", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"586e5b1c-fe84-4966-a99c-108aa56b2c5f\"", request_id: "ee6b1b8f-093c-42a2-9bdd-b1ba379b7bfc" } file = sled-agent/src/rack_setup/service.rs:1065
18342025-02-28T11:09:13.227ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7117c0d6-0c9b-4f1a-ab9e-32a66cb3deee", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"586e5b1c-fe84-4966-a99c-108aa56b2c5f\"", request_id: "7117c0d6-0c9b-4f1a-ab9e-32a66cb3deee" } file = sled-agent/src/rack_setup/service.rs:1065
18352025-02-28T11:09:14.844ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "71e9d533-e68e-4a1f-8db6-e0d2ec75e731", "content-length": "173", "date": "Fri, 28 Feb 2025 11:09:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"586e5b1c-fe84-4966-a99c-108aa56b2c5f\"", request_id: "71e9d533-e68e-4a1f-8db6-e0d2ec75e731" } file = sled-agent/src/rack_setup/service.rs:1065
18362025-02-28T11:09:14.901ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
18372025-02-28T11:09:14.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63839
18382025-02-28T11:09:15.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18392025-02-28T11:09:15.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18402025-02-28T11:09:15.002ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
18412025-02-28T11:09:15.003ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
18422025-02-28T11:09:15.016ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18432025-02-28T11:09:15.016ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a
18442025-02-28T11:09:15.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18452025-02-28T11:09:15.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528
18462025-02-28T11:09:15.059ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18472025-02-28T11:09:15.059ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275
18482025-02-28T11:09:15.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18492025-02-28T11:09:15.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa8e53ef-f341-4626-a351-436b60107fd4
18502025-02-28T11:09:15.099ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18512025-02-28T11:09:15.099ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dce85aac-5feb-46f0-9268-e34ae310482f
18522025-02-28T11:09:15.119ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18532025-02-28T11:09:15.119ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb
18542025-02-28T11:09:15.142ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18552025-02-28T11:09:15.142ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59
18562025-02-28T11:09:15.162ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18572025-02-28T11:09:15.162ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57c9df87-515e-406c-b81d-f5a8f2f31360
18582025-02-28T11:09:15.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18592025-02-28T11:09:15.183ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eced58b-69b0-4a58-a7df-32c6431e950a
18602025-02-28T11:09:15.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 194870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63839 req_id = 33c0eae6-67d8-4fc3-a85d-344ddc53f7cc response_code = 200 uri = /inventory
18612025-02-28T11:09:19.022ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36189
18622025-02-28T11:09:19.022ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36189 req_id = c59ee34c-5298-4c18-8582-ab7536f93ad8 response_code = 200 uri = /baseboard
18632025-02-28T11:09:19.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41109
18642025-02-28T11:09:19.251ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18652025-02-28T11:09:19.251ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18662025-02-28T11:09:19.252ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18672025-02-28T11:09:19.252ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18682025-02-28T11:09:19.252ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18692025-02-28T11:09:19.252ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18702025-02-28T11:09:19.252ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18712025-02-28T11:09:19.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5926 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41109 req_id = d31ac2ca-0378-471f-b71f-f05886e17516 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18722025-02-28T11:09:19.253ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1075
18732025-02-28T11:09:19.256ZINFOSledAgent (RSS): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18742025-02-28T11:09:19.257ZINFOSledAgent (RSS): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18752025-02-28T11:09:19.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61917
18762025-02-28T11:09:19.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18772025-02-28T11:09:19.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18782025-02-28T11:09:19.482ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
18792025-02-28T11:09:19.482ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
18802025-02-28T11:09:19.494ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18812025-02-28T11:09:19.494ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a
18822025-02-28T11:09:19.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18832025-02-28T11:09:19.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528
18842025-02-28T11:09:19.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18852025-02-28T11:09:19.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275
18862025-02-28T11:09:19.568ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18872025-02-28T11:09:19.568ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa8e53ef-f341-4626-a351-436b60107fd4
18882025-02-28T11:09:19.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18892025-02-28T11:09:19.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dce85aac-5feb-46f0-9268-e34ae310482f
18902025-02-28T11:09:19.616ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18912025-02-28T11:09:19.616ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb
18922025-02-28T11:09:19.640ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18932025-02-28T11:09:19.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59
18942025-02-28T11:09:19.661ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18952025-02-28T11:09:19.662ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57c9df87-515e-406c-b81d-f5a8f2f31360
18962025-02-28T11:09:19.688ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18972025-02-28T11:09:19.689ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eced58b-69b0-4a58-a7df-32c6431e950a
18982025-02-28T11:09:19.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34718
18992025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19002025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19012025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19022025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19032025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
19042025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19052025-02-28T11:09:19.702ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19062025-02-28T11:09:19.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34718 req_id = dd55a9a7-4677-4390-989d-1b833fcbabf7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19072025-02-28T11:09:19.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61917 req_id = 5e363de4-3f4f-46a4-b1ca-7e791063a3ef response_code = 200 uri = /inventory
19082025-02-28T11:09:20.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47829
19092025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19102025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19112025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19122025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19132025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
19142025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19152025-02-28T11:09:20.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19162025-02-28T11:09:20.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47829 req_id = 6b5d9df2-a78d-4c85-9578-efc00693c67d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19172025-02-28T11:09:20.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59683
19182025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19192025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19202025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19222025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
19232025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19242025-02-28T11:09:20.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19252025-02-28T11:09:20.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59683 req_id = 2fcd66dd-7916-48d4-b8ba-1d496264470b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19262025-02-28T11:09:25.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34328
19272025-02-28T11:09:25.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34328 req_id = c201350f-18fb-426a-a255-bb7ffdba4d22 response_code = 200 uri = /vpc-routes
19282025-02-28T11:09:25.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19292025-02-28T11:09:25.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34328 req_id = ad90e5b9-5b9a-4fd6-a076-8a712aac4d25 response_code = 204 uri = /eip-gateways
19302025-02-28T11:09:26.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34328 req_id = 925d6d47-a89a-4c2d-9ae2-ba5cdff6f141 response_code = 204 uri = /vpc-routes
19312025-02-28T11:09:29.235ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19322025-02-28T11:09:34.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32882
19332025-02-28T11:09:34.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32882 req_id = 05866f57-691f-4001-9e7f-545aafef4936 response_code = 200 uri = /vpc-routes
19342025-02-28T11:09:34.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53239
19352025-02-28T11:09:34.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53239 req_id = 2590e2ad-5b5a-429b-8f19-a90d5ee4d19a response_code = 200 uri = /v2p
19362025-02-28T11:09:34.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19372025-02-28T11:09:34.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32882 req_id = b97eeea3-5d46-461e-8a32-960ecd246ea0 response_code = 204 uri = /eip-gateways
19382025-02-28T11:09:34.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32882 req_id = f1e68c01-20ce-4a2d-9eb8-3cff90d87655 response_code = 204 uri = /vpc-routes
19392025-02-28T11:09:34.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39204
19402025-02-28T11:09:34.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19412025-02-28T11:09:34.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19422025-02-28T11:09:34.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39204 req_id = eea40943-22b2-40b2-b0f4-37732f2fdaf7 response_code = 204 uri = /switch-ports
19432025-02-28T11:09:34.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3423 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39204 req_id = 0d23e925-9bf3-45af-ac05-d101c47acc3e response_code = 200 uri = /network-bootstore-config
19442025-02-28T11:09:34.683ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19452025-02-28T11:09:34.683ZINFOSledAgent (bootstore): Writing ledger to /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19462025-02-28T11:09:34.684ZINFOSledAgent (bootstore): Writing ledger to /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19472025-02-28T11:09:34.685ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19482025-02-28T11:09:34.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3905 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39204 req_id = 44feb1d3-1b66-4b13-baaf-ece138b763f2 response_code = 204 uri = /network-bootstore-config
19492025-02-28T11:09:34.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42784
19502025-02-28T11:09:34.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42784 req_id = 097d0507-6225-4865-b507-f3d229dcd7c4 response_code = 200 uri = /vpc-routes
19512025-02-28T11:09:34.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54529
19522025-02-28T11:09:34.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19532025-02-28T11:09:34.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19542025-02-28T11:09:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54529 req_id = a467b841-93fc-4ad1-b220-af934c0ea69e response_code = 204 uri = /switch-ports
19552025-02-28T11:09:34.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60652
19562025-02-28T11:09:34.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60423
19572025-02-28T11:09:34.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38299
19582025-02-28T11:09:34.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19592025-02-28T11:09:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42784 req_id = 107f8d02-5364-4d41-88f6-080009006e87 response_code = 204 uri = /eip-gateways
19602025-02-28T11:09:34.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54529 req_id = 38c49bd5-2ca0-46cb-a38d-4b0efa19f23a response_code = 200 uri = /network-bootstore-config
19612025-02-28T11:09:34.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38299 req_id = 0879450b-9d79-4bcb-9f74-023b4e09fde8 response_code = 200 uri = /v2p
19622025-02-28T11:09:34.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60652 req_id = adba57c6-6cf9-45db-b573-c54585a60876 response_code = 200 uri = /v2p
19632025-02-28T11:09:34.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60423 req_id = 1dd3093d-1d14-49c4-8824-0edda8f89ced response_code = 200 uri = /vpc-routes
19642025-02-28T11:09:34.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42784 req_id = d6e34dc2-2ec9-481c-a3bb-f2486576a20d response_code = 204 uri = /vpc-routes
19652025-02-28T11:09:34.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19662025-02-28T11:09:34.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60423 req_id = 66c3efd9-2464-4388-a758-f0987869453d response_code = 204 uri = /eip-gateways
19672025-02-28T11:09:34.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60423 req_id = caf453fa-11b2-41e5-93e0-bf25f5470f8c response_code = 204 uri = /vpc-routes
19682025-02-28T11:09:35.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38433
19692025-02-28T11:09:35.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19702025-02-28T11:09:35.127ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19712025-02-28T11:09:35.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38433 req_id = 6d536d58-083d-4899-95c5-0496ca56e643 response_code = 204 uri = /switch-ports
19722025-02-28T11:09:35.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38433 req_id = 7929b71f-d027-44b6-ab06-b8ae4b24dc18 response_code = 200 uri = /network-bootstore-config
19732025-02-28T11:09:47.083ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:32928 remote_addr = [fd00:1122:3344:101::d]:39980 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
19742025-02-28T11:09:47.104ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 19396 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = e25eb511-c79c-4a30-a3f1-69b4376ba2c9 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
19752025-02-28T11:09:49.058ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60683
19762025-02-28T11:09:49.058ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60683 req_id = 7e4872aa-0dbc-45e5-bedb-73884f61a792 response_code = 200 uri = /baseboard
19772025-02-28T11:10:04.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64041
19782025-02-28T11:10:04.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64041 req_id = 744efceb-9e16-4afe-bbff-5d1c040520ca response_code = 200 uri = /vpc-routes
19792025-02-28T11:10:04.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51192
19802025-02-28T11:10:04.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51192 req_id = 07ead79e-46ba-48c1-9b5c-4a0d692e4a0e response_code = 200 uri = /v2p
19812025-02-28T11:10:04.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19822025-02-28T11:10:04.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64041 req_id = c0196522-43c6-4b7b-bece-655f7a44d6fe response_code = 204 uri = /eip-gateways
19832025-02-28T11:10:04.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64041 req_id = 20085f9c-b2fa-432c-a971-046d3732af99 response_code = 204 uri = /vpc-routes
19842025-02-28T11:10:04.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63738
19852025-02-28T11:10:04.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
19862025-02-28T11:10:04.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
19872025-02-28T11:10:04.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116310 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63738 req_id = c3b2f286-4549-47b7-8536-c3b462da2a04 response_code = 204 uri = /switch-ports
19882025-02-28T11:10:04.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63738 req_id = 35d3b29f-19da-4ccc-a239-c0e74b244101 response_code = 200 uri = /network-bootstore-config
19892025-02-28T11:10:04.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35092
19902025-02-28T11:10:04.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35092 req_id = b357ec29-5b90-44ab-a017-c4262c7a11ca response_code = 200 uri = /vpc-routes
19912025-02-28T11:10:04.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19922025-02-28T11:10:04.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35092 req_id = a0dc218e-87a6-4048-8d30-197690f91396 response_code = 204 uri = /eip-gateways
19932025-02-28T11:10:04.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35092 req_id = e62ae38b-2fd0-4e56-bc21-b7456942a526 response_code = 204 uri = /vpc-routes
19942025-02-28T11:10:04.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57421
19952025-02-28T11:10:04.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57421 req_id = c12a4654-6faa-4866-8542-0acbc0088a07 response_code = 200 uri = /vpc-routes
19962025-02-28T11:10:04.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
19972025-02-28T11:10:04.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57421 req_id = 10609476-b532-4713-b098-15b68f395f23 response_code = 204 uri = /eip-gateways
19982025-02-28T11:10:04.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57421 req_id = 304740ab-8894-43d1-8fec-3e29cafd35d9 response_code = 204 uri = /vpc-routes
19992025-02-28T11:10:04.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52762
20002025-02-28T11:10:04.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52762 req_id = d38b4d0c-f889-449f-b50d-d3d0cd9ced7e response_code = 200 uri = /v2p
20012025-02-28T11:10:05.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43292
20022025-02-28T11:10:05.128ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20032025-02-28T11:10:05.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20042025-02-28T11:10:05.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43292 req_id = 05973874-3e46-40f3-b6d5-0c8272e850ea response_code = 204 uri = /switch-ports
20052025-02-28T11:10:05.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52877
20062025-02-28T11:10:05.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34129
20072025-02-28T11:10:05.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43292 req_id = 30ed3fc9-0bdc-4560-ba59-2d0e40529a95 response_code = 200 uri = /network-bootstore-config
20082025-02-28T11:10:05.221ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20092025-02-28T11:10:05.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52877 req_id = a8b90bae-ccbf-472d-8497-0debde27091a response_code = 200 uri = /v2p
20102025-02-28T11:10:05.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20112025-02-28T11:10:05.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34129 req_id = 81c20ead-9453-4a4a-add5-5047670c6589 response_code = 204 uri = /switch-ports
20122025-02-28T11:10:05.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34129 req_id = b9c09070-69f1-4742-92d5-9c798d3379df response_code = 200 uri = /network-bootstore-config
20132025-02-28T11:10:17.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9248 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 550b50ec-bf4f-4d7b-af7d-170bd37d2c73 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
20142025-02-28T11:10:19.136ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38969
20152025-02-28T11:10:19.136ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38969 req_id = 7cbdd6c3-2acd-437e-91de-b8bb2edd7e7e response_code = 200 uri = /baseboard
20162025-02-28T11:10:33.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51185
20172025-02-28T11:10:33.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51185 req_id = cd1f8dc2-3be1-4be9-a6e9-863780b7a356 response_code = 200 uri = /vpc-routes
20182025-02-28T11:10:34.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20192025-02-28T11:10:34.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51185 req_id = 293ef3fb-2810-4a0f-a509-6c0ca6f0809d response_code = 204 uri = /eip-gateways
20202025-02-28T11:10:34.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64078
20212025-02-28T11:10:34.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 24712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64078 req_id = 9d7976d2-5cb9-4ee8-b52e-d94113360356 response_code = 200 uri = /v2p
20222025-02-28T11:10:34.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34556
20232025-02-28T11:10:34.122ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20242025-02-28T11:10:34.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 879 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51185 req_id = a11cf06c-cbe9-423b-bad9-69d4468bd0a1 response_code = 204 uri = /vpc-routes
20252025-02-28T11:10:34.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20262025-02-28T11:10:34.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34556 req_id = 041209e2-18a7-4fea-8090-2a461b3b33a4 response_code = 204 uri = /switch-ports
20272025-02-28T11:10:34.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34556 req_id = a2397a9d-5f1f-4474-816f-de39f6dcc068 response_code = 200 uri = /network-bootstore-config
20282025-02-28T11:10:34.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60681
20292025-02-28T11:10:34.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60681 req_id = a6df4f73-6309-429c-88b4-3c2c43733b6c response_code = 200 uri = /vpc-routes
20302025-02-28T11:10:34.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47931
20312025-02-28T11:10:34.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47931 req_id = aaef674a-9b08-4910-a15e-f4373a9a8f99 response_code = 200 uri = /vpc-routes
20322025-02-28T11:10:34.766ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20332025-02-28T11:10:34.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60681 req_id = ed50257b-4270-450c-9b65-cc311e0c4966 response_code = 204 uri = /eip-gateways
20342025-02-28T11:10:34.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37101
20352025-02-28T11:10:34.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37101 req_id = 85bead00-36d7-4937-8e88-dc527c1a56e5 response_code = 200 uri = /v2p
20362025-02-28T11:10:34.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60681 req_id = d506c580-8aa3-4212-beb2-88dfb89d905c response_code = 204 uri = /vpc-routes
20372025-02-28T11:10:34.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57007
20382025-02-28T11:10:34.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20392025-02-28T11:10:34.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20402025-02-28T11:10:34.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57007 req_id = 47a8ea0a-af91-4bbc-a5d5-7547b0e64537 response_code = 204 uri = /switch-ports
20412025-02-28T11:10:34.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20422025-02-28T11:10:34.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47931 req_id = 08d8b28a-3e10-4800-b234-38488a747a85 response_code = 204 uri = /eip-gateways
20432025-02-28T11:10:34.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57007 req_id = 6d0d9ca2-53d1-4b26-8967-32634fd0c1fb response_code = 200 uri = /network-bootstore-config
20442025-02-28T11:10:34.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47931 req_id = 3c67a87b-536e-4780-af38-a3bf9368e342 response_code = 204 uri = /vpc-routes
20452025-02-28T11:10:34.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49666
20462025-02-28T11:10:34.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49666 req_id = a6b9d7da-1f88-4c02-b2e0-98f9bf13690c response_code = 200 uri = /v2p
20472025-02-28T11:10:34.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44942
20482025-02-28T11:10:34.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20492025-02-28T11:10:35.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20502025-02-28T11:10:35.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44942 req_id = 69e62a41-41a2-48f7-8863-26197f58b616 response_code = 204 uri = /switch-ports
20512025-02-28T11:10:35.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44942 req_id = efd5a124-f7ae-41f4-9894-4f61bc911c15 response_code = 200 uri = /network-bootstore-config
20522025-02-28T11:10:47.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = b20a356f-0e89-4773-b226-677e77f2d6d5 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
20532025-02-28T11:10:49.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38140
20542025-02-28T11:10:49.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38140 req_id = a249e682-fbcf-48f5-9782-8618ae9800cd response_code = 200 uri = /baseboard
20552025-02-28T11:11:04.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63062
20562025-02-28T11:11:04.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63062 req_id = c8cb0ecf-0802-4398-a94c-dcb71109a7bf response_code = 200 uri = /vpc-routes
20572025-02-28T11:11:04.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41636
20582025-02-28T11:11:04.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41636 req_id = d83ef00f-b149-40dd-ab16-15d6b8aadad6 response_code = 200 uri = /v2p
20592025-02-28T11:11:04.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41188
20602025-02-28T11:11:04.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20612025-02-28T11:11:04.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20622025-02-28T11:11:04.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41188 req_id = c86e876e-c99b-4082-b737-0337efe2a9cd response_code = 204 uri = /switch-ports
20632025-02-28T11:11:04.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41188 req_id = 2b6148b8-ef5c-4ed8-93df-7a950ad0b176 response_code = 200 uri = /network-bootstore-config
20642025-02-28T11:11:04.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20652025-02-28T11:11:04.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63062 req_id = 3d2d194f-bd0e-40ee-9329-505ecda505e1 response_code = 204 uri = /eip-gateways
20662025-02-28T11:11:04.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63062 req_id = 3ef3ba3e-62a3-4f59-9789-f40271863bec response_code = 204 uri = /vpc-routes
20672025-02-28T11:11:04.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42565
20682025-02-28T11:11:04.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42565 req_id = cfb024bc-3fb8-4178-9aeb-f8027bf51819 response_code = 200 uri = /vpc-routes
20692025-02-28T11:11:04.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20702025-02-28T11:11:04.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42565 req_id = f0aef434-292f-4f7d-afeb-1dcaccb6c1b9 response_code = 204 uri = /eip-gateways
20712025-02-28T11:11:04.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42565 req_id = 2aba7064-12a9-452a-81f7-05408559aba5 response_code = 204 uri = /vpc-routes
20722025-02-28T11:11:04.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62200
20732025-02-28T11:11:04.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62200 req_id = 082c8eb2-2fea-4f52-aa97-d15a91336d96 response_code = 200 uri = /v2p
20742025-02-28T11:11:04.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61513
20752025-02-28T11:11:04.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61513 req_id = c0e7249d-337a-4990-b4df-b58501ff6511 response_code = 200 uri = /vpc-routes
20762025-02-28T11:11:05.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58519
20772025-02-28T11:11:05.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58519 req_id = efe53aff-2167-43eb-bbe1-cb9057d3c82b response_code = 200 uri = /v2p
20782025-02-28T11:11:05.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49277
20792025-02-28T11:11:05.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20802025-02-28T11:11:05.059ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20812025-02-28T11:11:05.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49277 req_id = 498e2500-4f28-4f5a-a783-acf3574a432a response_code = 204 uri = /switch-ports
20822025-02-28T11:11:05.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20832025-02-28T11:11:05.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61513 req_id = 3ac3d2e3-a4d4-4251-9280-e42ed7e61ac7 response_code = 204 uri = /eip-gateways
20842025-02-28T11:11:05.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49277 req_id = 0545ecdd-5917-489e-a2d6-a416bd45415f response_code = 200 uri = /network-bootstore-config
20852025-02-28T11:11:05.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61513 req_id = 18c027ea-98df-4255-97b6-9463f01ce196 response_code = 204 uri = /vpc-routes
20862025-02-28T11:11:05.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64708
20872025-02-28T11:11:05.265ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
20882025-02-28T11:11:05.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
20892025-02-28T11:11:05.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64708 req_id = c1e7a686-d1ef-4e92-ac3a-9f4d20cad85a response_code = 204 uri = /switch-ports
20902025-02-28T11:11:05.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64708 req_id = a9d5fa7a-4d9f-4d75-a136-a746490d9713 response_code = 200 uri = /network-bootstore-config
20912025-02-28T11:11:17.088ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6315 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = d333a98c-78e9-4dc3-a08d-1cd256e5d3e1 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
20922025-02-28T11:11:19.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46382
20932025-02-28T11:11:19.202ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46382 req_id = 64e2a66c-8108-4d7b-a15f-a285dac40af0 response_code = 200 uri = /baseboard
20942025-02-28T11:11:33.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34938
20952025-02-28T11:11:33.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34938 req_id = 9f62d251-2faf-4319-8be7-ba277a11e67d response_code = 200 uri = /vpc-routes
20962025-02-28T11:11:33.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
20972025-02-28T11:11:33.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34938 req_id = 6a7ba9ad-c789-4b33-81a1-afe43f116f3e response_code = 204 uri = /eip-gateways
20982025-02-28T11:11:34.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60825
20992025-02-28T11:11:34.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21002025-02-28T11:11:34.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21012025-02-28T11:11:34.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60825 req_id = b66b6171-33c9-4bd9-91b6-1ac219517d1f response_code = 204 uri = /switch-ports
21022025-02-28T11:11:34.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47250
21032025-02-28T11:11:34.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34938 req_id = 92fdc0cc-892e-42a7-9197-4739682efdbb response_code = 204 uri = /vpc-routes
21042025-02-28T11:11:34.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60825 req_id = b639d5f0-fbc4-4233-90ac-7d326725b9c1 response_code = 200 uri = /network-bootstore-config
21052025-02-28T11:11:34.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47250 req_id = 982061ae-86d3-4043-afa8-c1add8311071 response_code = 200 uri = /v2p
21062025-02-28T11:11:34.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41477
21072025-02-28T11:11:34.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41477 req_id = a831bbf4-0269-4b4b-b134-9467da366a6e response_code = 200 uri = /vpc-routes
21082025-02-28T11:11:34.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21092025-02-28T11:11:34.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41477 req_id = 158635a8-f98e-4d66-a3b6-4eb273b78a9d response_code = 204 uri = /eip-gateways
21102025-02-28T11:11:34.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47123
21112025-02-28T11:11:34.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47123 req_id = adb0edde-7b14-439e-89d6-3a2a1f2533c0 response_code = 200 uri = /v2p
21122025-02-28T11:11:34.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41477 req_id = 7b94420b-8dc2-419d-8cbd-f7c9457ddbe8 response_code = 204 uri = /vpc-routes
21132025-02-28T11:11:34.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41552
21142025-02-28T11:11:34.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41552 req_id = 1c8ae89f-4bb3-4295-ae1d-62d126c39609 response_code = 200 uri = /vpc-routes
21152025-02-28T11:11:34.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21162025-02-28T11:11:34.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41552 req_id = cd4170b5-3973-42c7-b345-f842e41208c3 response_code = 204 uri = /eip-gateways
21172025-02-28T11:11:34.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64858
21182025-02-28T11:11:34.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21192025-02-28T11:11:34.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21202025-02-28T11:11:34.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64858 req_id = 05e6de9d-2d73-446b-8a99-85260bab5e23 response_code = 204 uri = /switch-ports
21212025-02-28T11:11:34.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33224
21222025-02-28T11:11:34.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64384
21232025-02-28T11:11:34.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64384 req_id = c3e3b655-14d5-4d96-93e4-e3c2c26549d1 response_code = 200 uri = /v2p
21242025-02-28T11:11:34.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64858 req_id = 4b6835b7-511c-4c94-9e65-56ce10bf296b response_code = 200 uri = /network-bootstore-config
21252025-02-28T11:11:34.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21262025-02-28T11:11:34.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41552 req_id = ffe6a83f-ef6e-469f-afc2-5216402a251e response_code = 204 uri = /vpc-routes
21272025-02-28T11:11:34.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21282025-02-28T11:11:35.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33224 req_id = 5bc4b904-0f97-4ecc-84f0-5f03ccb61622 response_code = 204 uri = /switch-ports
21292025-02-28T11:11:35.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33224 req_id = a65dbad6-8c5b-4079-a5da-6697e5d3981f response_code = 200 uri = /network-bootstore-config
21302025-02-28T11:11:47.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8241 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = e2e79f7e-1f5b-45bf-ad93-eee6ea8d1b50 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
21312025-02-28T11:11:49.239ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53712
21322025-02-28T11:11:49.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53712 req_id = 4cb4d05e-6fce-4004-997c-c71d2ccc1694 response_code = 200 uri = /baseboard
21332025-02-28T11:12:04.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41241
21342025-02-28T11:12:04.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41241 req_id = 68fc82c2-7be6-44fd-af18-036a89a8b8dd response_code = 200 uri = /vpc-routes
21352025-02-28T11:12:04.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21362025-02-28T11:12:04.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41241 req_id = 5124cd32-eeaf-42e3-b6f5-e83d4c4f9c57 response_code = 204 uri = /eip-gateways
21372025-02-28T11:12:04.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41241 req_id = cb600ff8-88fa-4d4a-bfe0-499204d3e413 response_code = 204 uri = /vpc-routes
21382025-02-28T11:12:04.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65373
21392025-02-28T11:12:04.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65373 req_id = 96eb7b9d-53e7-457c-93ca-ebef67d80f04 response_code = 200 uri = /v2p
21402025-02-28T11:12:04.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33147
21412025-02-28T11:12:04.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21422025-02-28T11:12:04.434ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21432025-02-28T11:12:04.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33147 req_id = 69ae7125-3087-43ce-985c-f384db00da85 response_code = 204 uri = /switch-ports
21442025-02-28T11:12:04.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33147 req_id = 9e084047-5e09-42be-91a9-0139eb40ae48 response_code = 200 uri = /network-bootstore-config
21452025-02-28T11:12:04.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47965
21462025-02-28T11:12:04.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47965 req_id = db6cde61-2a49-4959-ad9b-8a46dfd00882 response_code = 200 uri = /vpc-routes
21472025-02-28T11:12:04.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21482025-02-28T11:12:04.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47965 req_id = 878fe866-de70-4b5d-80bf-427212c5a73c response_code = 204 uri = /eip-gateways
21492025-02-28T11:12:04.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47965 req_id = 5396d9d6-5a01-424d-96c6-544f5b991586 response_code = 204 uri = /vpc-routes
21502025-02-28T11:12:04.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37269
21512025-02-28T11:12:04.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37269 req_id = c755f49e-9c4f-47da-bf50-7c0488bf7480 response_code = 200 uri = /vpc-routes
21522025-02-28T11:12:04.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51434
21532025-02-28T11:12:04.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51434 req_id = bfa0bd2a-cc9d-4741-839f-f4eeeeb72b94 response_code = 200 uri = /v2p
21542025-02-28T11:12:04.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21552025-02-28T11:12:04.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37269 req_id = e946a75b-b0c3-4e57-aaf9-d0c69827a019 response_code = 204 uri = /eip-gateways
21562025-02-28T11:12:04.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37269 req_id = 48976d20-010a-4264-8a0b-b81c483d98d0 response_code = 204 uri = /vpc-routes
21572025-02-28T11:12:05.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47014
21582025-02-28T11:12:05.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21592025-02-28T11:12:05.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21602025-02-28T11:12:05.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47014 req_id = c405a58e-652c-4607-8907-0a53658f06bf response_code = 204 uri = /switch-ports
21612025-02-28T11:12:05.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35868
21622025-02-28T11:12:05.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35868 req_id = 01d8e901-de45-4d4b-bc3d-8dfbc0fe2dfa response_code = 200 uri = /v2p
21632025-02-28T11:12:05.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47014 req_id = 928a6542-aa80-432e-a046-a687d258b6ad response_code = 200 uri = /network-bootstore-config
21642025-02-28T11:12:05.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51859
21652025-02-28T11:12:05.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21662025-02-28T11:12:05.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21672025-02-28T11:12:05.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51859 req_id = 2fde564d-4952-45a6-9857-9c8abbf95d95 response_code = 204 uri = /switch-ports
21682025-02-28T11:12:05.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51859 req_id = c448b66f-bcd3-4626-bbee-6bafe303bf91 response_code = 200 uri = /network-bootstore-config
21692025-02-28T11:12:17.093ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6413 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = ab3a5b73-2af5-4dd8-ad0f-d8f9ce954fc6 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
21702025-02-28T11:12:19.272ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53601
21712025-02-28T11:12:19.272ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53601 req_id = b9de1266-0cf2-4f7d-b1b1-e246784113d5 response_code = 200 uri = /baseboard
21722025-02-28T11:12:33.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37006
21732025-02-28T11:12:33.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37006 req_id = ddcf89e6-3505-4ba2-823c-de1c3b326f99 response_code = 200 uri = /vpc-routes
21742025-02-28T11:12:33.987ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21752025-02-28T11:12:33.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37006 req_id = baf0754e-cf50-45e5-865a-7d12b3f3b778 response_code = 204 uri = /eip-gateways
21762025-02-28T11:12:34.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41236
21772025-02-28T11:12:34.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41236 req_id = 56b54bae-b9e1-45ce-9610-02f014926144 response_code = 200 uri = /v2p
21782025-02-28T11:12:34.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37006 req_id = 4d8569b8-47be-4989-9fd1-25728b2c6caa response_code = 204 uri = /vpc-routes
21792025-02-28T11:12:34.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37879
21802025-02-28T11:12:34.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21812025-02-28T11:12:34.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21822025-02-28T11:12:34.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37879 req_id = d806b6c4-ea5f-4ba5-b730-c134354c7fa4 response_code = 204 uri = /switch-ports
21832025-02-28T11:12:34.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37879 req_id = 3512174e-c831-40f0-932f-def93fa10893 response_code = 200 uri = /network-bootstore-config
21842025-02-28T11:12:34.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65481
21852025-02-28T11:12:34.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65481 req_id = 90262e82-c437-4a7d-ae51-9c43578bcf84 response_code = 200 uri = /vpc-routes
21862025-02-28T11:12:34.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
21872025-02-28T11:12:34.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65481 req_id = c89fb623-7fff-4b14-996b-866e515302a5 response_code = 204 uri = /eip-gateways
21882025-02-28T11:12:34.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65481 req_id = e7f097ba-47c5-49e3-a880-957ea0fe4bd1 response_code = 204 uri = /vpc-routes
21892025-02-28T11:12:34.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43008
21902025-02-28T11:12:34.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
21912025-02-28T11:12:34.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
21922025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43008 req_id = 75bc8712-abec-4cf5-b201-a84fb84a0fe5 response_code = 204 uri = /switch-ports
21932025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34282
21942025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64398
21952025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65193
21962025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43008 req_id = 54eca0e2-be61-423f-8b65-1eaae0946831 response_code = 200 uri = /network-bootstore-config
21972025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64398 req_id = f27f017d-4d97-4e00-b10c-759ce7f8920f response_code = 200 uri = /vpc-routes
21982025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65193 req_id = 02352397-9c51-4fb3-9ac9-9f24dc1a4f7e response_code = 200 uri = /v2p
21992025-02-28T11:12:34.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34282 req_id = 089e58cb-d56c-48c5-95be-2e8d5ce393fc response_code = 200 uri = /v2p
22002025-02-28T11:12:34.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22012025-02-28T11:12:34.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64398 req_id = bd7e5e37-9446-42fd-a458-6e2266c176c1 response_code = 204 uri = /eip-gateways
22022025-02-28T11:12:34.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64398 req_id = 48174340-8588-47f3-8882-b054ee8a64cc response_code = 204 uri = /vpc-routes
22032025-02-28T11:12:35.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38751
22042025-02-28T11:12:35.006ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22052025-02-28T11:12:35.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22062025-02-28T11:12:35.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38751 req_id = 0b56dc9b-a815-4246-8941-07f602fbd312 response_code = 204 uri = /switch-ports
22072025-02-28T11:12:35.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38751 req_id = aa12b754-ba0e-4775-bf2e-6570892d4dfd response_code = 200 uri = /network-bootstore-config
22082025-02-28T11:12:47.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7693 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 27cba515-3448-4a70-b975-381d32d9b35b response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
22092025-02-28T11:12:49.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58954
22102025-02-28T11:12:49.304ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58954 req_id = 9eca7b4a-dad1-42d6-964a-8a27bbb5b9fb response_code = 200 uri = /baseboard
22112025-02-28T11:13:04.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56822
22122025-02-28T11:13:04.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56822 req_id = 30c54be1-5882-4add-9aee-37cf29466a30 response_code = 200 uri = /v2p
22132025-02-28T11:13:04.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39162
22142025-02-28T11:13:04.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39162 req_id = 6e0b01c4-ab58-4fb6-b7ca-c94512c0e110 response_code = 200 uri = /vpc-routes
22152025-02-28T11:13:04.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22162025-02-28T11:13:04.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39162 req_id = a43b35cb-87b6-4acb-b906-d1f39959fef3 response_code = 204 uri = /eip-gateways
22172025-02-28T11:13:04.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39162 req_id = 5074a1e1-edf9-4ba3-a43d-93e67867f5b8 response_code = 204 uri = /vpc-routes
22182025-02-28T11:13:04.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43164
22192025-02-28T11:13:04.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22202025-02-28T11:13:04.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22212025-02-28T11:13:04.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43164 req_id = e74796f9-4f25-42e8-a84c-0c8fd9daa589 response_code = 204 uri = /switch-ports
22222025-02-28T11:13:04.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43164 req_id = 72cceaac-94b1-4795-8679-0eb393441315 response_code = 200 uri = /network-bootstore-config
22232025-02-28T11:13:04.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55043
22242025-02-28T11:13:04.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55043 req_id = 768a30fc-b463-4260-8424-3a7c925b6946 response_code = 200 uri = /vpc-routes
22252025-02-28T11:13:04.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62195
22262025-02-28T11:13:04.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62195 req_id = 6b9b3be4-856a-4c18-b4d5-bf3462734f88 response_code = 200 uri = /vpc-routes
22272025-02-28T11:13:04.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22282025-02-28T11:13:04.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55043 req_id = 58c8ab45-8555-4b11-8e99-f45266b1f753 response_code = 204 uri = /eip-gateways
22292025-02-28T11:13:04.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58681
22302025-02-28T11:13:04.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58681 req_id = 4fe991c3-25d9-45e7-bb46-9ba3f31aae40 response_code = 200 uri = /v2p
22312025-02-28T11:13:04.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55043 req_id = bedc3564-bd2e-423c-8235-b143dc631522 response_code = 204 uri = /vpc-routes
22322025-02-28T11:13:04.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39129
22332025-02-28T11:13:04.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22342025-02-28T11:13:04.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22352025-02-28T11:13:05.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39129 req_id = 6f47fb50-0999-4598-85f9-811d6e3dc70e response_code = 204 uri = /switch-ports
22362025-02-28T11:13:05.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46211
22372025-02-28T11:13:05.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22382025-02-28T11:13:05.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39129 req_id = 27f0ffe0-5808-42f9-8620-00ae1f5240a9 response_code = 200 uri = /network-bootstore-config
22392025-02-28T11:13:05.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62195 req_id = c53362e2-ae9d-43f5-bd28-58d43c5f456b response_code = 204 uri = /eip-gateways
22402025-02-28T11:13:05.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22412025-02-28T11:13:05.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62195 req_id = 03b35adb-802e-4f06-af88-cd995e5f19b7 response_code = 204 uri = /vpc-routes
22422025-02-28T11:13:05.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22432025-02-28T11:13:05.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47070
22442025-02-28T11:13:05.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47070 req_id = aa4845a8-8547-4f74-86f4-458445247eec response_code = 200 uri = /v2p
22452025-02-28T11:13:05.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46211 req_id = 625596d2-24b1-415a-a33d-37913f11d9be response_code = 204 uri = /switch-ports
22462025-02-28T11:13:05.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46211 req_id = 6acfaec9-2871-4ec6-90d2-da1bda86dffa response_code = 200 uri = /network-bootstore-config
22472025-02-28T11:13:17.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6897 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = fa44665a-5a51-4092-b7f1-1c8d4592ebad response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
22482025-02-28T11:13:19.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65028
22492025-02-28T11:13:19.335ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65028 req_id = c287a160-0a8f-43f6-9469-2bbf4bfb5031 response_code = 200 uri = /baseboard
22502025-02-28T11:13:33.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33591
22512025-02-28T11:13:33.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33591 req_id = 6a5f33ff-b109-4a25-b732-3fe59e827634 response_code = 200 uri = /v2p
22522025-02-28T11:13:34.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51346
22532025-02-28T11:13:34.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51346 req_id = 13c55cac-5c0d-4b14-bc60-864df04a568d response_code = 200 uri = /vpc-routes
22542025-02-28T11:13:34.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22552025-02-28T11:13:34.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51346 req_id = e1686653-5ad6-4d81-83a8-0377ee578ce4 response_code = 204 uri = /eip-gateways
22562025-02-28T11:13:34.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51346 req_id = 439cc7ff-2657-4b28-9dce-16e8b1c34201 response_code = 204 uri = /vpc-routes
22572025-02-28T11:13:34.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49232
22582025-02-28T11:13:34.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22592025-02-28T11:13:34.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22602025-02-28T11:13:34.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49232 req_id = b8b1bcba-6056-4f58-aaec-f8b6ed5eddf9 response_code = 204 uri = /switch-ports
22612025-02-28T11:13:34.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49232 req_id = 45de723a-ac25-4c2c-bfdb-4441242a8188 response_code = 200 uri = /network-bootstore-config
22622025-02-28T11:13:34.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39755
22632025-02-28T11:13:34.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39755 req_id = 0ca03035-9421-497d-9c4f-f0728e2b3646 response_code = 200 uri = /vpc-routes
22642025-02-28T11:13:34.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51966
22652025-02-28T11:13:34.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51966 req_id = 38a3edbb-214c-44a9-9274-81f9b4e5d79d response_code = 200 uri = /vpc-routes
22662025-02-28T11:13:34.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22672025-02-28T11:13:34.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39755 req_id = ecabdbdb-1618-4cd9-8b94-aecdbd795ddc response_code = 204 uri = /eip-gateways
22682025-02-28T11:13:34.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22692025-02-28T11:13:34.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51966 req_id = d43d59f8-8555-4931-8913-057d290b5fc6 response_code = 204 uri = /eip-gateways
22702025-02-28T11:13:34.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39755 req_id = fdd971ef-2b01-4d8d-a6d2-33caeaacdad4 response_code = 204 uri = /vpc-routes
22712025-02-28T11:13:34.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51966 req_id = 1e4fd637-a342-4c6e-a342-ba463b0ff1db response_code = 204 uri = /vpc-routes
22722025-02-28T11:13:34.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40082
22732025-02-28T11:13:34.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40082 req_id = 73e11d08-0533-4aa1-8559-4a5964fd9e3c response_code = 200 uri = /v2p
22742025-02-28T11:13:34.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55044
22752025-02-28T11:13:34.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55044 req_id = e30e71d5-15d9-4556-b501-a800c60d02d0 response_code = 200 uri = /v2p
22762025-02-28T11:13:34.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33119
22772025-02-28T11:13:34.856ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22782025-02-28T11:13:34.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22792025-02-28T11:13:34.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33119 req_id = 19f33f7d-1a8d-4dfe-82d9-c42eee4c4851 response_code = 204 uri = /switch-ports
22802025-02-28T11:13:34.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40326
22812025-02-28T11:13:34.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33119 req_id = a5464121-9814-4f5a-8ce2-c0340f34ce04 response_code = 200 uri = /network-bootstore-config
22822025-02-28T11:13:34.952ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
22832025-02-28T11:13:34.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
22842025-02-28T11:13:35.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40326 req_id = 603ff46a-9988-4c66-8abe-368c3864ce71 response_code = 204 uri = /switch-ports
22852025-02-28T11:13:35.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40326 req_id = 0f72c2f3-e638-4656-be54-331e35b6c00e response_code = 200 uri = /network-bootstore-config
22862025-02-28T11:13:47.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6902 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = d463641e-31ff-4c50-b4d0-33b410ebf1d5 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
22872025-02-28T11:13:49.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33530
22882025-02-28T11:13:49.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33530 req_id = abd0f380-26d4-4d10-999c-c9471af07057 response_code = 200 uri = /baseboard
22892025-02-28T11:14:04.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34633
22902025-02-28T11:14:04.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34633 req_id = 2eb7bae1-e73f-4f59-98bf-e1ea7ace2228 response_code = 200 uri = /vpc-routes
22912025-02-28T11:14:04.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41844
22922025-02-28T11:14:04.206ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22932025-02-28T11:14:04.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41844 req_id = 91fd4326-cdbf-4ba4-a085-f3b601465753 response_code = 200 uri = /artifacts
22942025-02-28T11:14:04.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
22952025-02-28T11:14:04.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34633 req_id = 8d403ff0-84e4-49c7-9bd5-eeec4e7bdb60 response_code = 204 uri = /eip-gateways
22962025-02-28T11:14:04.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34633 req_id = ba0bc8f1-af6d-4ad4-915a-2c3699c5be60 response_code = 204 uri = /vpc-routes
22972025-02-28T11:14:04.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34359
22982025-02-28T11:14:04.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34359 req_id = 8a0361ef-7a93-45c9-82cc-ccf3f5782637 response_code = 200 uri = /v2p
22992025-02-28T11:14:04.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46798
23002025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23012025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23022025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23032025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23042025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23052025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23062025-02-28T11:14:04.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23072025-02-28T11:14:04.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 450 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46798 req_id = c193993c-1180-44b7-ab54-1f5c0f5ec7c6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23082025-02-28T11:14:04.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63014
23092025-02-28T11:14:04.417ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23102025-02-28T11:14:04.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23112025-02-28T11:14:04.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63014 req_id = b3017fe3-bf84-4120-8ad4-a985add2534e response_code = 204 uri = /switch-ports
23122025-02-28T11:14:04.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63014 req_id = 99cb1f82-8ce5-4114-9b22-85c3c0642e07 response_code = 200 uri = /network-bootstore-config
23132025-02-28T11:14:04.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40094
23142025-02-28T11:14:04.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40094 req_id = 7447b72e-3bb7-4c65-a3b7-d3f14005bba8 response_code = 200 uri = /vpc-routes
23152025-02-28T11:14:04.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63094
23162025-02-28T11:14:04.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63094 req_id = 1013f333-0084-4631-aeaa-a628eb23ae88 response_code = 200 uri = /vpc-routes
23172025-02-28T11:14:04.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43483
23182025-02-28T11:14:04.982ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23192025-02-28T11:14:04.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43483 req_id = 19d4a468-4d05-42d9-8e26-32afccd986be response_code = 200 uri = /artifacts
23202025-02-28T11:14:05.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
23212025-02-28T11:14:05.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40094 req_id = 281d8d6b-e59c-4cd0-a6b4-cf3729f9f496 response_code = 204 uri = /eip-gateways
23222025-02-28T11:14:05.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53914
23232025-02-28T11:14:05.029ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23242025-02-28T11:14:05.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53914 req_id = b78195ba-a1ca-467e-909e-0bdc60000459 response_code = 200 uri = /artifacts
23252025-02-28T11:14:05.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
23262025-02-28T11:14:05.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63094 req_id = 61214752-abde-40ab-88f6-f195979b6da3 response_code = 204 uri = /eip-gateways
23272025-02-28T11:14:05.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40094 req_id = a086acda-37e6-448e-9aff-619756bc9bb6 response_code = 204 uri = /vpc-routes
23282025-02-28T11:14:05.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63094 req_id = c94deaed-b109-4b8f-af9e-cb7848075dee response_code = 204 uri = /vpc-routes
23292025-02-28T11:14:05.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64412
23302025-02-28T11:14:05.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64412 req_id = 14d58f89-630b-49d8-bcb5-5ca98a4a53d1 response_code = 200 uri = /v2p
23312025-02-28T11:14:05.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42758
23322025-02-28T11:14:05.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42758 req_id = 142e05ee-56fa-4071-b0d2-e09814724b57 response_code = 200 uri = /v2p
23332025-02-28T11:14:05.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36323
23342025-02-28T11:14:05.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23352025-02-28T11:14:05.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23362025-02-28T11:14:05.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88785 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36323 req_id = bbcd08c6-0328-4974-81f3-32176cc811e1 response_code = 204 uri = /switch-ports
23372025-02-28T11:14:05.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52267
23382025-02-28T11:14:05.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55422
23392025-02-28T11:14:05.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36323 req_id = 682107ec-21b5-4515-9c99-cf1f6db1e1a4 response_code = 200 uri = /network-bootstore-config
23402025-02-28T11:14:05.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23412025-02-28T11:14:05.332ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23422025-02-28T11:14:05.337ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23432025-02-28T11:14:05.338ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23442025-02-28T11:14:05.338ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23452025-02-28T11:14:05.338ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23462025-02-28T11:14:05.338ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23472025-02-28T11:14:05.338ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23482025-02-28T11:14:05.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55422 req_id = e172d37b-aa04-4268-8dba-cab7def89ddd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23492025-02-28T11:14:05.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44995
23502025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23512025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23522025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23532025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23542025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23552025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23562025-02-28T11:14:05.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23572025-02-28T11:14:05.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44995 req_id = e4d94ce0-3457-479d-bc24-03fbbfd233ec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23582025-02-28T11:14:05.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23592025-02-28T11:14:05.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93588 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52267 req_id = 4ad8f1c6-0393-4e4d-a2d5-8641c6b65610 response_code = 204 uri = /switch-ports
23602025-02-28T11:14:05.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52267 req_id = a982380d-8012-461b-9ddc-f78ef5df17ea response_code = 200 uri = /network-bootstore-config
23612025-02-28T11:14:15.227ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23622025-02-28T11:14:15.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23632025-02-28T11:14:15.257ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2023, tv_nsec: 809776794 } time_to_next_cleanup = 599.99999413s
23642025-02-28T11:14:17.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6296 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = fc393789-4e14-4706-b38f-e1cd94698443 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
23652025-02-28T11:14:19.400ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54094
23662025-02-28T11:14:19.400ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54094 req_id = b4182f40-188f-4341-aae8-1db3963931b6 response_code = 200 uri = /baseboard
23672025-02-28T11:14:29.238ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23682025-02-28T11:14:33.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53911
23692025-02-28T11:14:33.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53911 req_id = 86937db1-9157-4b87-b86c-58bd833d5901 response_code = 200 uri = /vpc-routes
23702025-02-28T11:14:33.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
23712025-02-28T11:14:33.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53911 req_id = f2f0d6c3-eaa4-4b9c-84b8-bd7f3752f67a response_code = 204 uri = /eip-gateways
23722025-02-28T11:14:34.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33369
23732025-02-28T11:14:34.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33369 req_id = fa48facb-5c7c-491c-b726-5bddf8d07dbe response_code = 200 uri = /v2p
23742025-02-28T11:14:34.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53911 req_id = e2c06619-6ce5-4928-88e6-4585189c5103 response_code = 204 uri = /vpc-routes
23752025-02-28T11:14:34.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33655
23762025-02-28T11:14:34.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23772025-02-28T11:14:34.141ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23782025-02-28T11:14:34.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33655 req_id = 670f6dd0-bd58-431a-bd32-da4ba84a2020 response_code = 204 uri = /switch-ports
23792025-02-28T11:14:34.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33655 req_id = 2a2557da-a3c0-4cfb-8764-72f5edc2a813 response_code = 200 uri = /network-bootstore-config
23802025-02-28T11:14:34.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35675
23812025-02-28T11:14:34.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35675 req_id = dc0660ae-2828-45bd-97ab-7bad4b316381 response_code = 200 uri = /vpc-routes
23822025-02-28T11:14:34.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
23832025-02-28T11:14:34.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35675 req_id = bc19239d-f561-42c5-bca4-31515ee507f9 response_code = 204 uri = /eip-gateways
23842025-02-28T11:14:34.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35675 req_id = fa46e39b-555e-4eed-95a9-aad4fc93c3bd response_code = 204 uri = /vpc-routes
23852025-02-28T11:14:34.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36007
23862025-02-28T11:14:34.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36007 req_id = 853781d4-a34a-456c-b57d-e7a509357e27 response_code = 200 uri = /vpc-routes
23872025-02-28T11:14:34.830ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
23882025-02-28T11:14:34.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36007 req_id = 125c2b4d-9084-4bc9-9a62-0bcd24c7934d response_code = 204 uri = /eip-gateways
23892025-02-28T11:14:34.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51717
23902025-02-28T11:14:34.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23912025-02-28T11:14:34.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
23922025-02-28T11:14:34.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51717 req_id = 272c3cd4-1b5e-4d01-8f8a-9335a345adbd response_code = 204 uri = /switch-ports
23932025-02-28T11:14:34.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57528
23942025-02-28T11:14:34.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56247
23952025-02-28T11:14:34.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52597
23962025-02-28T11:14:34.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51717 req_id = 8dfc0f45-b7d6-494b-b346-737abe2178bd response_code = 200 uri = /network-bootstore-config
23972025-02-28T11:14:34.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
23982025-02-28T11:14:34.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52597 req_id = 31cfcddf-8763-45fe-a99b-e6674540f2d3 response_code = 200 uri = /v2p
23992025-02-28T11:14:34.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56247 req_id = 9faeb947-e684-4277-9ef6-fa9bdb69d5d0 response_code = 200 uri = /v2p
24002025-02-28T11:14:34.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36007 req_id = 79d73018-1dda-47ad-beae-e4a2609feff5 response_code = 204 uri = /vpc-routes
24012025-02-28T11:14:34.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24022025-02-28T11:14:35.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82232 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57528 req_id = ce59172e-75eb-4b37-80ee-cea1c0a7c7ff response_code = 204 uri = /switch-ports
24032025-02-28T11:14:35.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57528 req_id = c312e719-2b07-4101-8218-0d2f9552c6aa response_code = 200 uri = /network-bootstore-config
24042025-02-28T11:14:47.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6976 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 64cc4c16-bc52-4b97-b4c2-725a9dc742ea response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
24052025-02-28T11:14:49.432ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62470
24062025-02-28T11:14:49.432ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62470 req_id = e2ca00b2-f5c2-4551-be1c-3498649e544c response_code = 200 uri = /baseboard
24072025-02-28T11:15:04.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56659
24082025-02-28T11:15:04.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56659 req_id = 8e8a561a-ff77-43c3-88ff-14bd2e4bf644 response_code = 200 uri = /vpc-routes
24092025-02-28T11:15:04.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24102025-02-28T11:15:04.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56659 req_id = 57e31d0b-338e-4eb5-a02f-18021177f688 response_code = 204 uri = /eip-gateways
24112025-02-28T11:15:04.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34426
24122025-02-28T11:15:04.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34426 req_id = 0a14deea-f444-4b13-9989-e644d0eb1d9c response_code = 200 uri = /v2p
24132025-02-28T11:15:04.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56659 req_id = cb0885ae-e191-4726-863b-f64dfcfd6415 response_code = 204 uri = /vpc-routes
24142025-02-28T11:15:04.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55178
24152025-02-28T11:15:04.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24162025-02-28T11:15:04.445ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24172025-02-28T11:15:04.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55178 req_id = 7bb44148-90f2-4bda-9578-d03c9bd775f1 response_code = 204 uri = /switch-ports
24182025-02-28T11:15:04.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55178 req_id = 56efa258-9010-4efd-b77c-0827d8247308 response_code = 200 uri = /network-bootstore-config
24192025-02-28T11:15:04.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45038
24202025-02-28T11:15:04.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45038 req_id = 135dd645-fd05-41ba-af57-104a723885a6 response_code = 200 uri = /vpc-routes
24212025-02-28T11:15:04.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24222025-02-28T11:15:04.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45038 req_id = 26d65a16-d587-4b28-a210-34daa42f36b9 response_code = 204 uri = /eip-gateways
24232025-02-28T11:15:04.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45038 req_id = d7e1f791-685d-480d-a847-957820d263b0 response_code = 204 uri = /vpc-routes
24242025-02-28T11:15:04.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45796
24252025-02-28T11:15:04.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45796 req_id = 6049a852-5a9e-476e-850a-8ff990bce923 response_code = 200 uri = /vpc-routes
24262025-02-28T11:15:05.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24272025-02-28T11:15:05.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45796 req_id = 67425cee-2e03-42be-9d99-f155adfbafa2 response_code = 204 uri = /eip-gateways
24282025-02-28T11:15:05.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36099
24292025-02-28T11:15:05.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36099 req_id = 424fe824-2023-4591-b30f-257fbb393a13 response_code = 200 uri = /v2p
24302025-02-28T11:15:05.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45796 req_id = a76dcc0d-e8a1-496d-a7ee-fd1c1a9da443 response_code = 204 uri = /vpc-routes
24312025-02-28T11:15:05.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56272
24322025-02-28T11:15:05.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24332025-02-28T11:15:05.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24342025-02-28T11:15:05.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56272 req_id = 8cd8e369-d951-4ff8-906f-a84c5ae3b9ba response_code = 204 uri = /switch-ports
24352025-02-28T11:15:05.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33935
24362025-02-28T11:15:05.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44252
24372025-02-28T11:15:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56272 req_id = de1f7718-eb3d-418a-8cf9-a6209eb0145b response_code = 200 uri = /network-bootstore-config
24382025-02-28T11:15:05.132ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24392025-02-28T11:15:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44252 req_id = 156a37d0-c9ae-4671-a259-4a9d4d20df72 response_code = 200 uri = /v2p
24402025-02-28T11:15:05.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24412025-02-28T11:15:05.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33935 req_id = 27796598-2b08-46ca-8637-0d6f20c38995 response_code = 204 uri = /switch-ports
24422025-02-28T11:15:05.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33935 req_id = 6771d442-8727-400e-8886-b7f852402de1 response_code = 200 uri = /network-bootstore-config
24432025-02-28T11:15:17.094ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9740 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = cb0267c2-a001-4ece-8822-8287cd53a403 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
24442025-02-28T11:15:19.465ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48162
24452025-02-28T11:15:19.465ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48162 req_id = 5f58fa19-86f3-4d9c-bcda-ee9a5109598a response_code = 200 uri = /baseboard
24462025-02-28T11:15:33.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46063
24472025-02-28T11:15:33.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46063 req_id = bac16bd9-e698-486c-b020-d2f198de52b2 response_code = 200 uri = /vpc-routes
24482025-02-28T11:15:33.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24492025-02-28T11:15:33.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46063 req_id = 8d59fb5a-c427-4f55-aad9-2fcbd347c559 response_code = 204 uri = /eip-gateways
24502025-02-28T11:15:33.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46063 req_id = 51ecc7ad-47d0-41da-90c2-10c9c8246b6c response_code = 204 uri = /vpc-routes
24512025-02-28T11:15:33.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57449
24522025-02-28T11:15:33.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57449 req_id = 6fbd28d5-18ae-42c0-90b2-c6542bbb9bfe response_code = 200 uri = /v2p
24532025-02-28T11:15:34.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53795
24542025-02-28T11:15:34.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24552025-02-28T11:15:34.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24562025-02-28T11:15:34.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53795 req_id = f1dc8c0a-1df8-4168-aa46-55d39300585b response_code = 204 uri = /switch-ports
24572025-02-28T11:15:34.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53795 req_id = 0e6b5a80-86ee-4d45-b828-dd63df07999d response_code = 200 uri = /network-bootstore-config
24582025-02-28T11:15:34.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52527
24592025-02-28T11:15:34.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52527 req_id = 1de429bb-4907-4a65-bd1e-731a8ff21e2d response_code = 200 uri = /vpc-routes
24602025-02-28T11:15:34.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36935
24612025-02-28T11:15:34.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36935 req_id = 248e9ced-3d18-4bda-9513-96c815512535 response_code = 200 uri = /v2p
24622025-02-28T11:15:34.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24632025-02-28T11:15:34.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52527 req_id = b5698a32-7dca-443d-8dfa-06b7f6112bee response_code = 204 uri = /eip-gateways
24642025-02-28T11:15:34.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52527 req_id = df5b8c8b-a087-4ea4-81f9-09a466f890de response_code = 204 uri = /vpc-routes
24652025-02-28T11:15:34.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40813
24662025-02-28T11:15:34.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40813 req_id = d6b33b17-dbb3-4999-9829-df291a92c766 response_code = 200 uri = /vpc-routes
24672025-02-28T11:15:34.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54229
24682025-02-28T11:15:34.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24692025-02-28T11:15:34.829ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24702025-02-28T11:15:34.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91410 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54229 req_id = f6a2ab1e-5bed-47ad-89d1-270dda294403 response_code = 204 uri = /switch-ports
24712025-02-28T11:15:34.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62862
24722025-02-28T11:15:34.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24732025-02-28T11:15:34.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40813 req_id = f6ba0516-ff9d-4c43-aa2d-90e7a7025665 response_code = 204 uri = /eip-gateways
24742025-02-28T11:15:34.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54229 req_id = 15e69bad-ec37-4946-bec4-821ece3f0b5e response_code = 200 uri = /network-bootstore-config
24752025-02-28T11:15:34.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62862 req_id = 6b829e5a-5329-44c3-80b6-5a0f601bb266 response_code = 200 uri = /v2p
24762025-02-28T11:15:34.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42516
24772025-02-28T11:15:34.890ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24782025-02-28T11:15:34.928ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24792025-02-28T11:15:34.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42516 req_id = 111c6a24-8342-4397-9a91-17a2182cf97f response_code = 204 uri = /switch-ports
24802025-02-28T11:15:34.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42516 req_id = 61052f2e-d138-4770-8bd7-4d46fab48630 response_code = 200 uri = /network-bootstore-config
24812025-02-28T11:15:34.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40813 req_id = 86e05023-6392-41c9-9468-a891e4c0876c response_code = 204 uri = /vpc-routes
24822025-02-28T11:15:47.090ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6242 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 5a270cec-9b22-479f-b585-b9be488a1760 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
24832025-02-28T11:15:49.504ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39156
24842025-02-28T11:15:49.504ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39156 req_id = 5b484fdd-85d9-4ca5-99a2-c8e6942f3259 response_code = 200 uri = /baseboard
24852025-02-28T11:16:03.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55049
24862025-02-28T11:16:03.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55049 req_id = 4ed60792-f20a-4d6e-87e1-51a645c70ebe response_code = 200 uri = /vpc-routes
24872025-02-28T11:16:04.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
24882025-02-28T11:16:04.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55049 req_id = 55661d68-fc34-42d2-8a9e-bb1d1b09a06f response_code = 204 uri = /eip-gateways
24892025-02-28T11:16:04.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55049 req_id = d75c75f0-fc52-48a3-b08b-2afde5408fb9 response_code = 204 uri = /vpc-routes
24902025-02-28T11:16:04.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42835
24912025-02-28T11:16:04.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42835 req_id = 8514f612-5623-4af8-955a-c0cf8f699d39 response_code = 200 uri = /v2p
24922025-02-28T11:16:04.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64850
24932025-02-28T11:16:04.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
24942025-02-28T11:16:04.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
24952025-02-28T11:16:04.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64850 req_id = b91319a8-9f17-4fe8-be42-4de08db4ae67 response_code = 204 uri = /switch-ports
24962025-02-28T11:16:04.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64850 req_id = e505a6c6-7253-416c-b4ba-f5a5ad5d3120 response_code = 200 uri = /network-bootstore-config
24972025-02-28T11:16:04.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49687
24982025-02-28T11:16:04.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49687 req_id = fd286c90-8ab5-43c3-a0f0-968dc1da2169 response_code = 200 uri = /vpc-routes
24992025-02-28T11:16:04.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25002025-02-28T11:16:04.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49687 req_id = 9fa44775-8fcc-4b40-86cf-7288995949bd response_code = 204 uri = /eip-gateways
25012025-02-28T11:16:04.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49687 req_id = 32c4e8d2-0d38-44e2-8498-5c8c051ab9e9 response_code = 204 uri = /vpc-routes
25022025-02-28T11:16:04.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51114
25032025-02-28T11:16:04.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51114 req_id = 88b388d4-c382-401d-be89-1d3a2e2b5036 response_code = 200 uri = /vpc-routes
25042025-02-28T11:16:05.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50332
25052025-02-28T11:16:05.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50332 req_id = 6fc429a3-f100-4183-85b2-ad7906940873 response_code = 200 uri = /v2p
25062025-02-28T11:16:05.032ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25072025-02-28T11:16:05.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51114 req_id = 116f4ebd-ccb9-4a37-87ad-77dde8e685fd response_code = 204 uri = /eip-gateways
25082025-02-28T11:16:05.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59789
25092025-02-28T11:16:05.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25102025-02-28T11:16:05.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25112025-02-28T11:16:05.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59789 req_id = 2a14968a-1033-46ff-bab3-78bda266be9d response_code = 204 uri = /switch-ports
25122025-02-28T11:16:05.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51114 req_id = 6adcb031-2085-4110-8131-a87e603b582d response_code = 204 uri = /vpc-routes
25132025-02-28T11:16:05.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59789 req_id = 844df85c-59fc-4754-ba9f-2bd166edcb4c response_code = 200 uri = /network-bootstore-config
25142025-02-28T11:16:05.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51669
25152025-02-28T11:16:05.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51669 req_id = ad59b450-04d3-477a-9c7d-f0ece5f07ddb response_code = 200 uri = /v2p
25162025-02-28T11:16:05.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41498
25172025-02-28T11:16:05.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25182025-02-28T11:16:05.254ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25192025-02-28T11:16:05.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41498 req_id = e06a2c36-faa7-49ff-8a7c-3fde7ac18033 response_code = 204 uri = /switch-ports
25202025-02-28T11:16:05.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41498 req_id = 09d0b584-0d91-4522-bf25-c0f8d62fbc1f response_code = 200 uri = /network-bootstore-config
25212025-02-28T11:16:17.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6286 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = bd92a7b5-326d-457e-877f-601da253b7a4 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
25222025-02-28T11:16:19.537ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55439
25232025-02-28T11:16:19.537ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55439 req_id = 1735a813-6943-40e6-b14c-b4f70d457580 response_code = 200 uri = /baseboard
25242025-02-28T11:16:33.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52183
25252025-02-28T11:16:33.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52183 req_id = 346529f9-b480-4e6d-b7c6-8401e02e6aad response_code = 200 uri = /vpc-routes
25262025-02-28T11:16:34.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25272025-02-28T11:16:34.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52183 req_id = 0758ab2c-6c05-4c01-8a12-35b07e515a87 response_code = 204 uri = /eip-gateways
25282025-02-28T11:16:34.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52183 req_id = dccdbbce-4452-4125-91c4-f9f1f3d18073 response_code = 204 uri = /vpc-routes
25292025-02-28T11:16:34.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63590
25302025-02-28T11:16:34.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63590 req_id = 01fdc3f9-9b61-461a-ab94-a5091a96dbb4 response_code = 200 uri = /v2p
25312025-02-28T11:16:34.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58735
25322025-02-28T11:16:34.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25332025-02-28T11:16:34.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25342025-02-28T11:16:34.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93884 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58735 req_id = 70142783-216f-4035-91e8-825b50a57e70 response_code = 204 uri = /switch-ports
25352025-02-28T11:16:34.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58735 req_id = cb580698-f521-49a6-82ac-5353d8a7d454 response_code = 200 uri = /network-bootstore-config
25362025-02-28T11:16:34.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54850
25372025-02-28T11:16:34.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54850 req_id = e401a7fd-9c99-445a-80d7-9d078911cdc7 response_code = 200 uri = /vpc-routes
25382025-02-28T11:16:34.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25392025-02-28T11:16:34.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54850 req_id = 5abcf9d4-caf4-4cfa-a2c5-e598ced828ca response_code = 204 uri = /eip-gateways
25402025-02-28T11:16:34.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54850 req_id = 16ced5ba-0891-4663-af23-22dc46f576d7 response_code = 204 uri = /vpc-routes
25412025-02-28T11:16:34.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49962
25422025-02-28T11:16:34.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25432025-02-28T11:16:34.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25442025-02-28T11:16:34.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49962 req_id = c2e33ae8-3c45-4d13-8d51-bd3a8a342d3a response_code = 204 uri = /switch-ports
25452025-02-28T11:16:34.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62419
25462025-02-28T11:16:34.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65527
25472025-02-28T11:16:34.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65527 req_id = 1291f252-2515-4973-95bd-23323c5dc576 response_code = 200 uri = /v2p
25482025-02-28T11:16:34.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62419 req_id = b60e59aa-6574-4d90-8e3f-f32925e6e176 response_code = 200 uri = /vpc-routes
25492025-02-28T11:16:34.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49962 req_id = a6f8abc7-6173-4e23-a768-a35cd6252508 response_code = 200 uri = /network-bootstore-config
25502025-02-28T11:16:34.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25512025-02-28T11:16:34.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62419 req_id = e7a17f1e-b21a-4465-abca-b2f3ef009f2b response_code = 204 uri = /eip-gateways
25522025-02-28T11:16:34.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62419 req_id = 49f7650a-7db2-4548-b84c-9d355c4c5a24 response_code = 204 uri = /vpc-routes
25532025-02-28T11:16:34.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58715
25542025-02-28T11:16:34.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58715 req_id = 1c2ff55f-df13-4f3a-9fa5-80e59ee53bc1 response_code = 200 uri = /v2p
25552025-02-28T11:16:35.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38129
25562025-02-28T11:16:35.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25572025-02-28T11:16:35.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25582025-02-28T11:16:35.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38129 req_id = 59e48ce5-fdef-4f28-9085-1b5aeb9d558c response_code = 204 uri = /switch-ports
25592025-02-28T11:16:35.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38129 req_id = 7de39237-21aa-41a7-8ffb-05ff342e9697 response_code = 200 uri = /network-bootstore-config
25602025-02-28T11:16:47.092ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7353 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 46483254-d821-4445-872b-459288cb5b5c response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
25612025-02-28T11:16:49.571ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55619
25622025-02-28T11:16:49.571ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55619 req_id = 234ebfe0-200f-4bc4-8c0c-f3d3004a37d9 response_code = 200 uri = /baseboard
25632025-02-28T11:17:04.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43515
25642025-02-28T11:17:04.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43515 req_id = 84ef6ee0-c74c-4931-853f-16f02a481a5d response_code = 200 uri = /vpc-routes
25652025-02-28T11:17:04.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25662025-02-28T11:17:04.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43515 req_id = f5872e28-af6b-49ac-a5fb-30c3ac2ba8c6 response_code = 204 uri = /eip-gateways
25672025-02-28T11:17:04.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43515 req_id = 69b2704d-28f3-4553-a1ac-2d79616d2e8b response_code = 204 uri = /vpc-routes
25682025-02-28T11:17:04.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47223
25692025-02-28T11:17:04.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47223 req_id = 3fea3df8-2531-443a-9c7e-e79489cc8b67 response_code = 200 uri = /v2p
25702025-02-28T11:17:04.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53394
25712025-02-28T11:17:04.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25722025-02-28T11:17:04.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25732025-02-28T11:17:04.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53394 req_id = e08f64b7-07ba-4554-a81c-964e6b391d5b response_code = 204 uri = /switch-ports
25742025-02-28T11:17:04.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53394 req_id = a22cc921-5356-4601-b373-478f4526cd24 response_code = 200 uri = /network-bootstore-config
25752025-02-28T11:17:04.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44289
25762025-02-28T11:17:04.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44289 req_id = 6794bbc8-f2e7-4fad-804c-ac14dfdc77d6 response_code = 200 uri = /vpc-routes
25772025-02-28T11:17:04.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25782025-02-28T11:17:04.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44289 req_id = fe83dd77-0c6d-4214-8245-590941da6cee response_code = 204 uri = /eip-gateways
25792025-02-28T11:17:04.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44289 req_id = f93ff818-f6d1-409b-b702-06969de081cf response_code = 204 uri = /vpc-routes
25802025-02-28T11:17:04.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44593
25812025-02-28T11:17:04.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44593 req_id = 44b3707d-8978-402c-97b8-059a1b46adcc response_code = 200 uri = /v2p
25822025-02-28T11:17:04.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36617
25832025-02-28T11:17:04.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36617 req_id = 02461d78-50c8-4cce-a206-c820954cef7b response_code = 200 uri = /vpc-routes
25842025-02-28T11:17:04.961ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
25852025-02-28T11:17:04.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36617 req_id = 6da00930-3d22-4658-97ad-a0c77a4b7649 response_code = 204 uri = /eip-gateways
25862025-02-28T11:17:04.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35947
25872025-02-28T11:17:04.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25882025-02-28T11:17:05.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25892025-02-28T11:17:05.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35947 req_id = 8dc76b29-7507-4564-9ff5-e84afa0c4095 response_code = 204 uri = /switch-ports
25902025-02-28T11:17:05.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35947 req_id = 60413af9-701f-4159-be8b-8893a8d651bf response_code = 200 uri = /network-bootstore-config
25912025-02-28T11:17:05.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36617 req_id = 8e72e22c-fd92-42d1-a5bb-3d2c1c75d50b response_code = 204 uri = /vpc-routes
25922025-02-28T11:17:05.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57257
25932025-02-28T11:17:05.253ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
25942025-02-28T11:17:05.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
25952025-02-28T11:17:05.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57257 req_id = e8d2b732-89a6-4059-9233-519cf496a618 response_code = 204 uri = /switch-ports
25962025-02-28T11:17:05.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52712
25972025-02-28T11:17:05.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57257 req_id = 30435dad-8455-47a1-93dd-3a7c836a1c54 response_code = 200 uri = /network-bootstore-config
25982025-02-28T11:17:05.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52712 req_id = 793d05ec-4671-4a92-9c23-5987907fc621 response_code = 200 uri = /v2p
25992025-02-28T11:17:17.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6567 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = bff2136d-8713-49db-82f4-045f08df8c1a response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
26002025-02-28T11:17:19.604ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58670
26012025-02-28T11:17:19.604ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58670 req_id = d38a552c-4edb-40dd-94b0-27961612d519 response_code = 200 uri = /baseboard
26022025-02-28T11:17:33.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55438
26032025-02-28T11:17:33.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55438 req_id = 9eb647d2-d6ac-4283-bf5d-6ae4434d262d response_code = 200 uri = /vpc-routes
26042025-02-28T11:17:34.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26052025-02-28T11:17:34.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55438 req_id = 5fc0bc13-fb61-4ebc-8009-4215ab0692f0 response_code = 204 uri = /eip-gateways
26062025-02-28T11:17:34.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55438 req_id = 2275540a-d93a-40fa-af6d-662415075844 response_code = 204 uri = /vpc-routes
26072025-02-28T11:17:34.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59685
26082025-02-28T11:17:34.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59685 req_id = d96fbc53-3799-4764-9a75-36d6350d7041 response_code = 200 uri = /v2p
26092025-02-28T11:17:34.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38092
26102025-02-28T11:17:34.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26112025-02-28T11:17:34.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26122025-02-28T11:17:34.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38092 req_id = e4bc79a7-d6fb-4fad-a7c4-2d1dab079048 response_code = 204 uri = /switch-ports
26132025-02-28T11:17:34.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38092 req_id = 3ff62c11-8325-4639-ad29-810651ab7af4 response_code = 200 uri = /network-bootstore-config
26142025-02-28T11:17:34.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45430
26152025-02-28T11:17:34.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45430 req_id = 002ca1a7-09e7-42d8-afa2-e5c612007b83 response_code = 200 uri = /vpc-routes
26162025-02-28T11:17:34.637ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26172025-02-28T11:17:34.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45430 req_id = 9c8438b1-0059-4665-a3ec-1f3a96e0079c response_code = 204 uri = /eip-gateways
26182025-02-28T11:17:34.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45430 req_id = 9b3fcd81-6fda-449a-a31a-1c13ff881636 response_code = 204 uri = /vpc-routes
26192025-02-28T11:17:34.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62764
26202025-02-28T11:17:34.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26212025-02-28T11:17:34.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26222025-02-28T11:17:34.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62764 req_id = 1d200ea6-dd3b-41a0-bca2-4901da075d1e response_code = 204 uri = /switch-ports
26232025-02-28T11:17:34.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36390
26242025-02-28T11:17:34.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36390 req_id = 323b5e36-6491-4dad-9c09-6da0fd40a011 response_code = 200 uri = /v2p
26252025-02-28T11:17:34.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62764 req_id = f7bb6cd1-1b89-44f9-990b-0aa56bcdafe3 response_code = 200 uri = /network-bootstore-config
26262025-02-28T11:17:34.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60147
26272025-02-28T11:17:34.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60147 req_id = 78a2bde5-e5cb-4d98-869a-854a153c4d29 response_code = 200 uri = /vpc-routes
26282025-02-28T11:17:34.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59895
26292025-02-28T11:17:34.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59895 req_id = 710bdbfd-939a-462c-9fd2-0f4df9b7564d response_code = 200 uri = /v2p
26302025-02-28T11:17:34.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26312025-02-28T11:17:34.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60147 req_id = bc2677fd-57c5-4f90-89f2-c0616946ca27 response_code = 204 uri = /eip-gateways
26322025-02-28T11:17:34.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60147 req_id = cfc103ef-089d-4136-8aa8-a1f29fab8220 response_code = 204 uri = /vpc-routes
26332025-02-28T11:17:34.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37271
26342025-02-28T11:17:34.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26352025-02-28T11:17:34.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26362025-02-28T11:17:35.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93501 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37271 req_id = 6771d996-f1dc-4000-bd51-ccfe783ecb53 response_code = 204 uri = /switch-ports
26372025-02-28T11:17:35.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37271 req_id = ad632c6f-354e-4272-8806-bda19b41030a response_code = 200 uri = /network-bootstore-config
26382025-02-28T11:17:47.091ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6629 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = f08761a2-7a57-40c8-ade6-b7e2dc57c645 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
26392025-02-28T11:17:49.636ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57053
26402025-02-28T11:17:49.636ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57053 req_id = dd3d755a-2dce-4272-93fe-177ea42aa429 response_code = 200 uri = /baseboard
26412025-02-28T11:18:04.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62009
26422025-02-28T11:18:04.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62009 req_id = 97af653b-7b5a-49ac-abe8-4ea2cad8482f response_code = 200 uri = /vpc-routes
26432025-02-28T11:18:04.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26442025-02-28T11:18:04.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62009 req_id = 4938e3e8-e797-416b-8a6d-31b7232a57d5 response_code = 204 uri = /eip-gateways
26452025-02-28T11:18:04.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62009 req_id = 0196dd19-4c9a-47cd-a89f-2d7dd180726e response_code = 204 uri = /vpc-routes
26462025-02-28T11:18:04.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37172
26472025-02-28T11:18:04.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37172 req_id = 11694aec-3eae-4682-926d-fb3896cea356 response_code = 200 uri = /v2p
26482025-02-28T11:18:04.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49360
26492025-02-28T11:18:04.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26502025-02-28T11:18:04.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26512025-02-28T11:18:04.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49360 req_id = 7a1dd098-59d0-472d-9648-4a12379b8f7f response_code = 204 uri = /switch-ports
26522025-02-28T11:18:04.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49360 req_id = 78781cb5-b1b4-4b84-abbf-e3c835f79fed response_code = 200 uri = /network-bootstore-config
26532025-02-28T11:18:04.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62810
26542025-02-28T11:18:04.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62810 req_id = b6fd6fc2-5ecb-42e1-a8de-f8aab978386c response_code = 200 uri = /vpc-routes
26552025-02-28T11:18:04.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26562025-02-28T11:18:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62810 req_id = a7abc5ab-e925-4dde-abba-6211ed8661cc response_code = 204 uri = /eip-gateways
26572025-02-28T11:18:04.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62810 req_id = de35664c-32d6-4948-bb27-11456653cb63 response_code = 204 uri = /vpc-routes
26582025-02-28T11:18:04.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48968
26592025-02-28T11:18:04.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48968 req_id = 4ba6a9a4-7d6c-4a7f-806f-1ac15e2512ed response_code = 200 uri = /vpc-routes
26602025-02-28T11:18:04.890ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26612025-02-28T11:18:04.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48968 req_id = dac2e85b-cceb-45e4-a7b1-9ef99fa037e4 response_code = 204 uri = /eip-gateways
26622025-02-28T11:18:04.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48968 req_id = f86198f3-fe97-4f6c-a29b-a146445896c3 response_code = 204 uri = /vpc-routes
26632025-02-28T11:18:04.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40628
26642025-02-28T11:18:04.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40628 req_id = 34a8c076-dcc2-4f71-b11c-70fdd0dd900a response_code = 200 uri = /v2p
26652025-02-28T11:18:04.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45854
26662025-02-28T11:18:04.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45854 req_id = e4cf85d1-880b-4e20-931e-87e07302917d response_code = 200 uri = /v2p
26672025-02-28T11:18:05.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54598
26682025-02-28T11:18:05.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26692025-02-28T11:18:05.052ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26702025-02-28T11:18:05.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54598 req_id = 8bce47df-42bd-4161-a46a-4114d24c344e response_code = 204 uri = /switch-ports
26712025-02-28T11:18:05.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54598 req_id = c25d740d-a389-47e9-9a6f-88f66d798686 response_code = 200 uri = /network-bootstore-config
26722025-02-28T11:18:05.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52039
26732025-02-28T11:18:05.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26742025-02-28T11:18:05.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26752025-02-28T11:18:05.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86910 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52039 req_id = 8193dac4-f52c-4d4e-ac46-51660b65db45 response_code = 204 uri = /switch-ports
26762025-02-28T11:18:05.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52039 req_id = 8b607b15-419a-4e87-aea8-59ee841a5a6d response_code = 200 uri = /network-bootstore-config
26772025-02-28T11:18:17.092ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6999 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 40f14282-7f3d-42e8-a2f8-85f5dc520523 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
26782025-02-28T11:18:19.670ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60654
26792025-02-28T11:18:19.670ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60654 req_id = dfba1c29-206d-47f2-b403-ee2a21b72d3e response_code = 200 uri = /baseboard
26802025-02-28T11:18:33.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63528
26812025-02-28T11:18:33.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63528 req_id = 2dd733b8-4d77-4d98-a840-352e42da9c3d response_code = 200 uri = /vpc-routes
26822025-02-28T11:18:34.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26832025-02-28T11:18:34.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63528 req_id = b30c53c3-8f4d-4c50-9509-0de248e31cc5 response_code = 204 uri = /eip-gateways
26842025-02-28T11:18:34.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63528 req_id = a43dac68-a0f1-405a-9bda-119a6e77073d response_code = 204 uri = /vpc-routes
26852025-02-28T11:18:34.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58128
26862025-02-28T11:18:34.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
26872025-02-28T11:18:34.114ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
26882025-02-28T11:18:34.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91328 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58128 req_id = 86b90e64-88be-4d79-bdc9-56c698a6275c response_code = 204 uri = /switch-ports
26892025-02-28T11:18:34.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63883
26902025-02-28T11:18:34.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63883 req_id = 309d6917-2804-422e-a7b0-5d03b5ab7f09 response_code = 200 uri = /v2p
26912025-02-28T11:18:34.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58128 req_id = 457c20c2-34b7-4bea-9e39-712c00a55b88 response_code = 200 uri = /network-bootstore-config
26922025-02-28T11:18:34.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32993
26932025-02-28T11:18:34.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32993 req_id = 179b82c6-83d0-44ae-a503-c9e702d174b5 response_code = 200 uri = /vpc-routes
26942025-02-28T11:18:34.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
26952025-02-28T11:18:34.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32993 req_id = b0922a4d-5745-47af-b89e-dec31f83d144 response_code = 204 uri = /eip-gateways
26962025-02-28T11:18:34.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43935
26972025-02-28T11:18:34.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43935 req_id = 94a6c429-cf9b-483d-9473-84f96b656996 response_code = 200 uri = /v2p
26982025-02-28T11:18:34.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32993 req_id = 882fd1c3-da42-4ead-bfe7-074b1b2f9fe0 response_code = 204 uri = /vpc-routes
26992025-02-28T11:18:34.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63921
27002025-02-28T11:18:34.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27012025-02-28T11:18:34.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27022025-02-28T11:18:34.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63921 req_id = 63f626cd-dfc8-4f68-82ed-c5b1c74aeeed response_code = 204 uri = /switch-ports
27032025-02-28T11:18:34.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61880
27042025-02-28T11:18:34.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38971
27052025-02-28T11:18:34.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38971 req_id = c851ca1d-23ff-466c-80dd-f92b5f446747 response_code = 200 uri = /v2p
27062025-02-28T11:18:34.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61880 req_id = 67959eaf-67fd-4c02-9eb1-f3872ade2059 response_code = 200 uri = /vpc-routes
27072025-02-28T11:18:34.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63921 req_id = af48ea80-1371-43d1-b480-839edd6fe6b4 response_code = 200 uri = /network-bootstore-config
27082025-02-28T11:18:34.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56980
27092025-02-28T11:18:34.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27102025-02-28T11:18:34.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27112025-02-28T11:18:34.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56980 req_id = f4668ade-a290-4a0d-8384-f137a7581246 response_code = 204 uri = /switch-ports
27122025-02-28T11:18:34.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56980 req_id = e3eeb691-6f4f-4449-94fa-673bdfdd439f response_code = 200 uri = /network-bootstore-config
27132025-02-28T11:18:34.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
27142025-02-28T11:18:34.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61880 req_id = 15a8d37f-ec2b-4180-98fc-a1d564bde1f3 response_code = 204 uri = /eip-gateways
27152025-02-28T11:18:34.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61880 req_id = ba2825d5-39de-4e9a-b29e-d3264b1cf944 response_code = 204 uri = /vpc-routes
27162025-02-28T11:18:47.092ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6982 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = acd879b6-ac12-4b70-97ac-6dff167c473d response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
27172025-02-28T11:18:49.703ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46229
27182025-02-28T11:18:49.703ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46229 req_id = 1c8680dc-2beb-4a0c-873a-c8dee0946f13 response_code = 200 uri = /baseboard
27192025-02-28T11:19:04.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59015
27202025-02-28T11:19:04.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59015 req_id = 7c7c9689-9c38-4665-810d-f6f4e69d69ee response_code = 200 uri = /vpc-routes
27212025-02-28T11:19:04.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40317
27222025-02-28T11:19:04.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27232025-02-28T11:19:04.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40317 req_id = 30063b8c-81f1-4e46-99c0-628608c0185a response_code = 200 uri = /artifacts
27242025-02-28T11:19:04.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
27252025-02-28T11:19:04.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59015 req_id = ba84a851-5314-4d64-b881-1f10eea8778a response_code = 204 uri = /eip-gateways
27262025-02-28T11:19:04.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59015 req_id = 1bbc0802-84b8-4aea-bac8-cea62754aeb2 response_code = 204 uri = /vpc-routes
27272025-02-28T11:19:04.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60683
27282025-02-28T11:19:04.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60683 req_id = 97b8bff3-62a3-4039-ba20-096c7d2acdac response_code = 200 uri = /v2p
27292025-02-28T11:19:04.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48505
27302025-02-28T11:19:04.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27312025-02-28T11:19:04.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
27322025-02-28T11:19:04.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48505 req_id = 77e9edb0-b173-41db-bc9f-d293310384d9 response_code = 204 uri = /switch-ports
27332025-02-28T11:19:04.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56170
27342025-02-28T11:19:04.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27352025-02-28T11:19:04.514ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27362025-02-28T11:19:04.514ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
27372025-02-28T11:19:04.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48505 req_id = fae14a1a-1637-4c45-8790-f609b4a15a7e response_code = 200 uri = /network-bootstore-config
27382025-02-28T11:19:04.515ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
27392025-02-28T11:19:04.528ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27402025-02-28T11:19:04.528ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a
27412025-02-28T11:19:04.552ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27422025-02-28T11:19:04.552ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528
27432025-02-28T11:19:04.575ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27442025-02-28T11:19:04.575ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275
27452025-02-28T11:19:04.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27462025-02-28T11:19:04.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa8e53ef-f341-4626-a351-436b60107fd4
27472025-02-28T11:19:04.624ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27482025-02-28T11:19:04.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dce85aac-5feb-46f0-9268-e34ae310482f
27492025-02-28T11:19:04.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49975
27502025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27512025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27532025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27542025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
27552025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27562025-02-28T11:19:04.633ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27572025-02-28T11:19:04.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49975 req_id = 9c09daa9-7097-4430-91de-cb9c99fb3958 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27582025-02-28T11:19:04.663ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27592025-02-28T11:19:04.663ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb
27602025-02-28T11:19:04.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27612025-02-28T11:19:04.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59
27622025-02-28T11:19:04.723ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27632025-02-28T11:19:04.723ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57c9df87-515e-406c-b81d-f5a8f2f31360
27642025-02-28T11:19:04.748ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27652025-02-28T11:19:04.748ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eced58b-69b0-4a58-a7df-32c6431e950a
27662025-02-28T11:19:04.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56170 req_id = 4482a3f0-a943-40b4-9c44-6169e4bc8e99 response_code = 200 uri = /inventory
27672025-02-28T11:19:04.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60864
27682025-02-28T11:19:04.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60864 req_id = 7fcff74e-3d08-4195-b6a9-2e623a60d18f response_code = 200 uri = /vpc-routes
27692025-02-28T11:19:04.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43389
27702025-02-28T11:19:04.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27712025-02-28T11:19:04.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43389 req_id = d972e32e-d9f6-4eb0-bd91-28edb1a12af0 response_code = 200 uri = /artifacts
27722025-02-28T11:19:05.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
27732025-02-28T11:19:05.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60864 req_id = 6da70a5a-4afe-450b-b6b3-b67d8cb0600d response_code = 204 uri = /eip-gateways
27742025-02-28T11:19:05.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60864 req_id = 1c4090f8-23f5-4945-a207-f61514f26470 response_code = 204 uri = /vpc-routes
27752025-02-28T11:19:05.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37150
27762025-02-28T11:19:05.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37150 req_id = 1cfb7b20-69b7-4a00-84af-2af37cbbd91f response_code = 200 uri = /vpc-routes
27772025-02-28T11:19:05.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32921
27782025-02-28T11:19:05.166ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27792025-02-28T11:19:05.166ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27802025-02-28T11:19:05.166ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
27812025-02-28T11:19:05.166ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
27822025-02-28T11:19:05.178ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27832025-02-28T11:19:05.178ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a
27842025-02-28T11:19:05.200ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27852025-02-28T11:19:05.200ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528
27862025-02-28T11:19:05.226ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-02-28T11:19:05.226ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275
27882025-02-28T11:19:05.250ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27892025-02-28T11:19:05.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa8e53ef-f341-4626-a351-436b60107fd4
27902025-02-28T11:19:05.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27912025-02-28T11:19:05.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dce85aac-5feb-46f0-9268-e34ae310482f
27922025-02-28T11:19:05.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59455
27932025-02-28T11:19:05.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59455 req_id = 5da1643d-6e92-41d0-a0b7-6c8dbc8bf444 response_code = 200 uri = /v2p
27942025-02-28T11:19:05.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27952025-02-28T11:19:05.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb
27962025-02-28T11:19:05.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55907
27972025-02-28T11:19:05.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
27982025-02-28T11:19:05.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27992025-02-28T11:19:05.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59
28002025-02-28T11:19:05.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28012025-02-28T11:19:05.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57c9df87-515e-406c-b81d-f5a8f2f31360
28022025-02-28T11:19:05.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28032025-02-28T11:19:05.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45379
28042025-02-28T11:19:05.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
28052025-02-28T11:19:05.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 776 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37150 req_id = f4e67b01-2ff2-488b-b8d1-dd7c0a375723 response_code = 204 uri = /eip-gateways
28062025-02-28T11:19:05.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37518
28072025-02-28T11:19:05.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28082025-02-28T11:19:05.389ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28092025-02-28T11:19:05.389ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28102025-02-28T11:19:05.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28112025-02-28T11:19:05.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37518 req_id = 106bfa63-cc3e-47f7-bb6e-739d6ee6104c response_code = 200 uri = /artifacts
28122025-02-28T11:19:05.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28132025-02-28T11:19:05.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28142025-02-28T11:19:05.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28152025-02-28T11:19:05.390ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28162025-02-28T11:19:05.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45379 req_id = dbefac4b-4e16-43f7-b256-3bb424c49c28 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28172025-02-28T11:19:05.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37150 req_id = 57356fb3-6c5a-481e-9e28-a83491f1c9e4 response_code = 204 uri = /vpc-routes
28182025-02-28T11:19:05.399ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28192025-02-28T11:19:05.399ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eced58b-69b0-4a58-a7df-32c6431e950a
28202025-02-28T11:19:05.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250090 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32921 req_id = a8fa3367-ccdb-49e4-8d6d-294c761063bb response_code = 200 uri = /inventory
28212025-02-28T11:19:05.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55907 req_id = 75f107f7-23cc-4df2-bf4c-7c04e4e5140a response_code = 204 uri = /switch-ports
28222025-02-28T11:19:05.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55907 req_id = e3b6156f-10d9-4b67-84c4-b687d4beca96 response_code = 200 uri = /network-bootstore-config
28232025-02-28T11:19:05.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61018
28242025-02-28T11:19:05.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28252025-02-28T11:19:05.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28262025-02-28T11:19:05.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61018 req_id = f32e2e74-6784-4785-88e8-bc0d743886cb response_code = 204 uri = /switch-ports
28272025-02-28T11:19:05.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61018 req_id = 3fde7853-e4b5-4dee-8210-8a5e0cc54550 response_code = 200 uri = /network-bootstore-config
28282025-02-28T11:19:05.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37885
28292025-02-28T11:19:05.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37885 req_id = 2f0cf898-b282-4eda-9f72-21f74cbc3f07 response_code = 200 uri = /v2p
28302025-02-28T11:19:05.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49824
28312025-02-28T11:19:05.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28322025-02-28T11:19:05.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28332025-02-28T11:19:05.581ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/config/omicron-zones.json file = common/src/ledger.rs:177
28342025-02-28T11:19:05.582ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/config/omicron-zones.json file = common/src/ledger.rs:177
28352025-02-28T11:19:05.594ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a7e2e214-a7ba-4d30-8a32-802c72b68a3a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28362025-02-28T11:19:05.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a7e2e214-a7ba-4d30-8a32-802c72b68a3a
28372025-02-28T11:19:05.615ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bd463c8-f45b-4c5c-ab78-d036ead35528 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28382025-02-28T11:19:05.615ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bd463c8-f45b-4c5c-ab78-d036ead35528
28392025-02-28T11:19:05.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3ed385a-cd9d-422a-b620-0c368a5b7275 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28402025-02-28T11:19:05.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3ed385a-cd9d-422a-b620-0c368a5b7275
28412025-02-28T11:19:05.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa8e53ef-f341-4626-a351-436b60107fd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28422025-02-28T11:19:05.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa8e53ef-f341-4626-a351-436b60107fd4
28432025-02-28T11:19:05.678ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dce85aac-5feb-46f0-9268-e34ae310482f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28442025-02-28T11:19:05.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dce85aac-5feb-46f0-9268-e34ae310482f
28452025-02-28T11:19:05.699ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f49df8d5-a990-4cc4-991f-958f6fd872bb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28462025-02-28T11:19:05.699ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f49df8d5-a990-4cc4-991f-958f6fd872bb
28472025-02-28T11:19:05.718ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b7be4b87-5b67-4526-86cc-07dffc1acb59 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28482025-02-28T11:19:05.718ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b7be4b87-5b67-4526-86cc-07dffc1acb59
28492025-02-28T11:19:05.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 57c9df87-515e-406c-b81d-f5a8f2f31360 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28502025-02-28T11:19:05.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_57c9df87-515e-406c-b81d-f5a8f2f31360
28512025-02-28T11:19:05.754ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eced58b-69b0-4a58-a7df-32c6431e950a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28522025-02-28T11:19:05.754ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eced58b-69b0-4a58-a7df-32c6431e950a
28532025-02-28T11:19:05.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 183670 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49824 req_id = d833384a-94fc-4ce4-8976-98f0dae98c04 response_code = 200 uri = /inventory
28542025-02-28T11:19:05.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65473
28552025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28562025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28572025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28582025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28592025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28602025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28612025-02-28T11:19:05.853ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28622025-02-28T11:19:05.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65473 req_id = 1d06f882-06ce-48a3-8db6-f021b46bd30d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28632025-02-28T11:19:17.092ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6211 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 096d61a4-d98f-4a62-b755-5d20378800ac response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
28642025-02-28T11:19:19.736ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50346
28652025-02-28T11:19:19.736ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50346 req_id = 0ac18e35-eff7-49b8-9bb6-e820a747c32d response_code = 200 uri = /baseboard
28662025-02-28T11:19:29.242ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28672025-02-28T11:19:33.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37091
28682025-02-28T11:19:33.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37091 req_id = a2b788fc-a17c-4890-901a-7ae8dd87575f response_code = 200 uri = /vpc-routes
28692025-02-28T11:19:33.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57022
28702025-02-28T11:19:33.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57022 req_id = 3d1dded2-f72e-490d-aae4-6d3eb4fb2aa4 response_code = 200 uri = /v2p
28712025-02-28T11:19:33.993ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
28722025-02-28T11:19:33.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37091 req_id = a1ef77e4-bf08-45f7-9187-0caa2a78c954 response_code = 204 uri = /eip-gateways
28732025-02-28T11:19:34.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37091 req_id = ad964b43-ea5e-4968-92db-1fe49a01df1d response_code = 204 uri = /vpc-routes
28742025-02-28T11:19:34.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57264
28752025-02-28T11:19:34.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28762025-02-28T11:19:34.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28772025-02-28T11:19:34.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57264 req_id = e56a1b89-7b50-44f1-9bf6-e269436998bf response_code = 204 uri = /switch-ports
28782025-02-28T11:19:34.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57264 req_id = 420080a3-45ee-4e17-93b4-3ef763596152 response_code = 200 uri = /network-bootstore-config
28792025-02-28T11:19:34.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64991
28802025-02-28T11:19:34.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64991 req_id = 4f42c7d5-e492-4599-b048-3b48d82a9922 response_code = 200 uri = /vpc-routes
28812025-02-28T11:19:34.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60687
28822025-02-28T11:19:34.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60687 req_id = 5036ee3f-9d71-4052-bd4e-784d3effc89e response_code = 200 uri = /vpc-routes
28832025-02-28T11:19:34.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
28842025-02-28T11:19:34.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64991 req_id = 6412a3af-6f2e-4cb3-b91e-4ab99fec1395 response_code = 204 uri = /eip-gateways
28852025-02-28T11:19:34.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64991 req_id = 8bf52a06-c8d4-48c2-bddb-98721a73ae45 response_code = 204 uri = /vpc-routes
28862025-02-28T11:19:34.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
28872025-02-28T11:19:34.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60687 req_id = d4f6436a-f299-4c8f-9fe6-601eac746bf0 response_code = 204 uri = /eip-gateways
28882025-02-28T11:19:34.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60687 req_id = e78e0f05-03a0-4c3a-b46c-db0d49b56877 response_code = 204 uri = /vpc-routes
28892025-02-28T11:19:34.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60787
28902025-02-28T11:19:34.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60787 req_id = abdffb0f-d55f-40e0-8086-831acb181806 response_code = 200 uri = /v2p
28912025-02-28T11:19:34.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61588
28922025-02-28T11:19:34.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
28932025-02-28T11:19:34.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
28942025-02-28T11:19:34.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61588 req_id = 7b3db627-87d1-4b9f-906c-d65b541a3948 response_code = 204 uri = /switch-ports
28952025-02-28T11:19:34.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47944
28962025-02-28T11:19:34.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64895
28972025-02-28T11:19:34.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64895 req_id = ba95e498-80f7-45b6-9778-172756dd16fe response_code = 200 uri = /v2p
28982025-02-28T11:19:34.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61588 req_id = 699a0b5b-9f1c-48f0-b783-e8cd46755162 response_code = 200 uri = /network-bootstore-config
28992025-02-28T11:19:34.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29002025-02-28T11:19:35.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29012025-02-28T11:19:35.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47944 req_id = 4e4dc209-4359-4e84-8573-61b5c546670b response_code = 204 uri = /switch-ports
29022025-02-28T11:19:35.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47944 req_id = 5fc53ee6-08cc-4f4a-8582-e23b5c910d14 response_code = 200 uri = /network-bootstore-config
29032025-02-28T11:19:37.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65268
29042025-02-28T11:19:37.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65268 req_id = 729cfcac-de43-41d2-9698-7d6d95342c06 response_code = 200 uri = /v2p
29052025-02-28T11:19:37.273ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16451675) }
29062025-02-28T11:19:37.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65268 req_id = 3771fd97-e601-44e9-a954-942e2ba3579e response_code = 204 uri = /v2p
29072025-02-28T11:19:37.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35073
29082025-02-28T11:19:37.368ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16451675))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e6320baa-6006-4982-a57b-ec87759a7138, slot: 0, read_only: false, vcr_json: .., name: "disk-835a11d4d33" }], boot_settings: Some(InstanceBootSettings { order: [e6320baa-6006-4982-a57b-ec87759a7138] }), cloud_init_bytes: Some(..) } instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 metadata = InstanceMetadata { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, project_id: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T11:19:37.360978055Z }
29092025-02-28T11:19:37.368ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 migration_id = None propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29102025-02-28T11:19:37.369ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 migration_id = None propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16451675))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55df1394-1be9-4232-9b7c-b1bb985e4810, kind: Instance { id: 33698fcc-4e6d-4949-8fd8-f637edfc3026 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16451675), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: e6320baa-6006-4982-a57b-ec87759a7138, slot: 0, read_only: false, vcr_json: .., name: "disk-835a11d4d33" }], boot_settings: Some(InstanceBootSettings { order: [e6320baa-6006-4982-a57b-ec87759a7138] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-02-28T11:19:37.360978055Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29112025-02-28T11:19:37.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 12219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35073 req_id = 66544bb9-0b4a-43ec-9010-a9291686db75 response_code = 200 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
29122025-02-28T11:19:37.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55017
29132025-02-28T11:19:37.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55017 req_id = 5309f9c0-ea1f-44bc-8bd5-796b0abb0dbf response_code = 200 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e/state
29142025-02-28T11:19:37.499ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16451675 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29152025-02-28T11:19:37.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29162025-02-28T11:19:37.551ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e file = illumos-utils/src/zone.rs:325 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29172025-02-28T11:19:37.582ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e file = illumos-utils/src/zone.rs:363 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29182025-02-28T11:19:37.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41332
29192025-02-28T11:19:37.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41332 req_id = a8557905-06de-4833-ab90-a28424dac759 response_code = 200 uri = /vpc-routes
29202025-02-28T11:19:37.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {55df1394-1be9-4232-9b7c-b1bb985e4810: {10.151.1.175: {731aab52-950d-43e3-bf3d-72f8aef44969}, 10.151.1.176: {731aab52-950d-43e3-bf3d-72f8aef44969}}} }
29212025-02-28T11:19:39.392ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29222025-02-28T11:19:39.392ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e zone file = illumos-utils/src/running_zone.rs:489 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29232025-02-28T11:19:39.580ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 54.806055ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29242025-02-28T11:19:39.645ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 90.246917ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29252025-02-28T11:19:39.758ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 140.075155ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29262025-02-28T11:19:39.914ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 511.207252ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29272025-02-28T11:19:40.438ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 888.876867ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29282025-02-28T11:19:41.338ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 774.524183ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29292025-02-28T11:19:42.123ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 815.056484ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29302025-02-28T11:19:42.951ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 1.482885851s file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29312025-02-28T11:19:44.446ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 666.98441ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e zone = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29322025-02-28T11:19:45.142ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e file = sled-agent/src/instance.rs:2133 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29332025-02-28T11:19:45.151ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 47.01161ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29342025-02-28T11:19:45.208ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 79.93611ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29352025-02-28T11:19:45.297ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 135.997434ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29362025-02-28T11:19:45.443ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 511.503614ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29372025-02-28T11:19:45.966ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 1.073603622s file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29382025-02-28T11:19:47.052ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 1.136743526s file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29392025-02-28T11:19:47.093ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6755 local_addr = [fd00:1122:3344:101::1]:32928 method = GET remote_addr = [fd00:1122:3344:101::d]:39980 req_id = 5a3368e2-7e10-4a3e-83aa-7cb2ac9e0a40 response_code = 200 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f uri = /586e5b1c-fe84-4966-a99c-108aa56b2c5f
29402025-02-28T11:19:48.201ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e") failed: Property not found. retry in 725.006337ms file = illumos-utils/src/svc.rs:42 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29412025-02-28T11:19:48.938ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29422025-02-28T11:19:48.976ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29432025-02-28T11:19:49.064ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29442025-02-28T11:19:49.065ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
29452025-02-28T11:19:49.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11307862 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41332 req_id = 3cd8b15f-5328-44fd-8d1f-04692d9661c3 response_code = 204 uri = /eip-gateways
29462025-02-28T11:19:49.070ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-02-28T11:19:49.070386637Z } file = sled-agent/src/instance.rs:842 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29472025-02-28T11:19:49.070ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T11:19:49.070386637Z } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29482025-02-28T11:19:49.070ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T11:19:49.070386637Z }, migration_in: None, migration_out: None }
29492025-02-28T11:19:49.169ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-02-28T11:19:49.169242814Z } file = sled-agent/src/instance.rs:842 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29502025-02-28T11:19:49.169ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T11:19:49.169242814Z } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29512025-02-28T11:19:49.169ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T11:19:49.169242814Z }, migration_in: None, migration_out: None }
29522025-02-28T11:19:49.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41332 req_id = 491062f5-5ffc-4e35-a0fe-799e5c648abc response_code = 204 uri = /vpc-routes
29532025-02-28T11:19:49.768ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46953
29542025-02-28T11:19:49.768ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46953 req_id = 3c4c9cb4-238a-45cb-9de7-29b58890bf85 response_code = 200 uri = /baseboard
29552025-02-28T11:20:00.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37493
29562025-02-28T11:20:00.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 780 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37493 req_id = 164a8072-067a-4529-92fb-43a742663591 response_code = 200 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e/state
29572025-02-28T11:20:00.405ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-02-28T11:20:00.405937979Z } file = sled-agent/src/instance.rs:842 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29582025-02-28T11:20:00.405ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T11:20:00.405937979Z } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29592025-02-28T11:20:00.406ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T11:20:00.405937979Z }, migration_in: None, migration_out: None }
29602025-02-28T11:20:00.466ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-02-28T11:20:00.466966066Z } file = sled-agent/src/instance.rs:842 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29612025-02-28T11:20:00.467ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-02-28T11:20:00.466966066Z } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29622025-02-28T11:20:00.467ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29632025-02-28T11:20:00.467ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29642025-02-28T11:20:00.467ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8460307226571187126 n_samples = 6 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
29652025-02-28T11:20:00.467ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29662025-02-28T11:20:00.467ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12579567551484521317 n_samples = 6 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
29672025-02-28T11:20:00.468ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/41a8c3ba-7d40-4a8d-99cb-4cba1b30f1a9/debug/bundle/zone", "/pool/int/df51d52c-5b47-4a54-948d-b88bd4a86cfe/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/a7e2e214-a7ba-4d30-8a32-802c72b68a3a/crypt/debug", "/pool/ext/2bd463c8-f45b-4c5c-ab78-d036ead35528/crypt/debug", "/pool/ext/b3ed385a-cd9d-422a-b620-0c368a5b7275/crypt/debug", "/pool/ext/fa8e53ef-f341-4626-a351-436b60107fd4/crypt/debug", "/pool/ext/dce85aac-5feb-46f0-9268-e34ae310482f/crypt/debug", "/pool/ext/f49df8d5-a990-4cc4-991f-958f6fd872bb/crypt/debug", "/pool/ext/b7be4b87-5b67-4526-86cc-07dffc1acb59/crypt/debug", "/pool/ext/57c9df87-515e-406c-b81d-f5a8f2f31360/crypt/debug", "/pool/ext/3eced58b-69b0-4a58-a7df-32c6431e950a/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e
29682025-02-28T11:20:01.126ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e", bundle_id: c414f3cc-1c1b-4199-b341-ff017c9dbc93 }, time_created: 2025-02-28T11:20:00.469403329Z, version: 0, cause: TerminatedInstance }
29692025-02-28T11:20:01.126ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_04f7b38a-fca9-49bc-b85b-42d63919aa2e file = sled-agent/src/instance.rs:1376 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29702025-02-28T11:20:02.862ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29712025-02-28T11:20:02.879ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(16451675), kind: System }
29722025-02-28T11:20:02.879ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(16451675), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29732025-02-28T11:20:02.879ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:20:02.879729059Z }, migration_in: None, migration_out: None }
29742025-02-28T11:20:02.932ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:20:02.879729059Z }, migration_in: None, migration_out: None }
29752025-02-28T11:20:02.936ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e
29762025-02-28T11:20:03.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41144
29772025-02-28T11:20:03.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41144 req_id = 0379ea44-3968-418b-949d-8ca0d5f8d336 response_code = 200 uri = /vpc-routes
29782025-02-28T11:20:03.552ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {55df1394-1be9-4232-9b7c-b1bb985e4810: {10.151.1.176: {731aab52-950d-43e3-bf3d-72f8aef44969}, 10.151.1.175: {731aab52-950d-43e3-bf3d-72f8aef44969}}} }
29792025-02-28T11:20:03.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41144 req_id = d64c75a4-7f22-4d35-b8bb-1a45c1ea5ae4 response_code = 204 uri = /eip-gateways
29802025-02-28T11:20:03.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41144 req_id = 9dda627f-9fda-439d-9bfb-5d7b3a0421b1 response_code = 204 uri = /vpc-routes
29812025-02-28T11:20:03.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47949
29822025-02-28T11:20:03.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47949 req_id = 46b2de49-b23f-4e02-8aca-2837055499f6 response_code = 200 uri = /v2p
29832025-02-28T11:20:04.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50652
29842025-02-28T11:20:04.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50652 req_id = 0122f0dc-e69c-4a85-a061-379774df25ad response_code = 200 uri = /v2p
29852025-02-28T11:20:04.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33912
29862025-02-28T11:20:04.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33912 req_id = 4197fc55-78d2-4834-ab3c-76e8e190e85b response_code = 200 uri = /vpc-routes
29872025-02-28T11:20:04.325ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
29882025-02-28T11:20:04.325ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f
29892025-02-28T11:20:04.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33912 req_id = 64e189f8-03c8-48b3-82d6-912111688aeb response_code = 204 uri = /eip-gateways
29902025-02-28T11:20:04.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33912 req_id = 33742e11-f2ee-4061-8990-eabe48b54c55 response_code = 204 uri = /vpc-routes
29912025-02-28T11:20:04.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65444
29922025-02-28T11:20:04.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
29932025-02-28T11:20:04.481ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
29942025-02-28T11:20:04.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65444 req_id = ee52b93f-0795-4a72-8699-0771e7d6b6a1 response_code = 204 uri = /switch-ports
29952025-02-28T11:20:04.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65444 req_id = 374789ea-b722-4e9b-b02b-afe29ca303fe response_code = 200 uri = /network-bootstore-config
29962025-02-28T11:20:04.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39734
29972025-02-28T11:20:04.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39734 req_id = 497a7b53-d157-40c8-bab3-3b178c0cacdd response_code = 200 uri = /vpc-routes
29982025-02-28T11:20:05.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
29992025-02-28T11:20:05.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39734 req_id = 558db92f-2022-4f57-af9c-3a5381090f89 response_code = 204 uri = /eip-gateways
30002025-02-28T11:20:05.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39734 req_id = a6067f6c-19ce-4393-940a-45b7e8d77fdc response_code = 204 uri = /vpc-routes
30012025-02-28T11:20:05.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59485
30022025-02-28T11:20:05.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59485 req_id = a3758164-5be3-4047-922a-bb3c2c1e5903 response_code = 200 uri = /vpc-routes
30032025-02-28T11:20:05.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
30042025-02-28T11:20:05.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59485 req_id = 9b60909d-2ca4-4129-8ef7-670488c67a40 response_code = 204 uri = /eip-gateways
30052025-02-28T11:20:05.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42967
30062025-02-28T11:20:05.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42967 req_id = 3484dd89-4dbe-40ee-874a-f43e49cc914e response_code = 200 uri = /v2p
30072025-02-28T11:20:05.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56121
30082025-02-28T11:20:05.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
30092025-02-28T11:20:05.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
30102025-02-28T11:20:05.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89113 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56121 req_id = 250ad696-3b08-4024-89c4-63cec5463894 response_code = 204 uri = /switch-ports
30112025-02-28T11:20:05.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56121 req_id = e1619e68-425d-464f-814c-d02c8018f542 response_code = 200 uri = /network-bootstore-config
30122025-02-28T11:20:05.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47417
30132025-02-28T11:20:05.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47417 req_id = 8b4faa32-2c1b-4f3c-b597-746e003c4224 response_code = 200 uri = /v2p
30142025-02-28T11:20:05.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59485 req_id = f0208bae-eabd-41b1-94ce-81f1a659db65 response_code = 204 uri = /vpc-routes
30152025-02-28T11:20:05.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37114
30162025-02-28T11:20:05.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4228
30172025-02-28T11:20:05.327ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4252
30182025-02-28T11:20:05.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37114 req_id = 365bdf9c-a43e-4b18-958c-ff6312978e17 response_code = 204 uri = /switch-ports
30192025-02-28T11:20:05.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37114 req_id = 43fdce82-cd2e-404b-83dc-80858840a105 response_code = 200 uri = /network-bootstore-config
30202025-02-28T11:20:06.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37562
30212025-02-28T11:20:06.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37562 req_id = 443f98da-9057-4cbe-99a4-0aabca3fb1ea response_code = 200 uri = /v2p
30222025-02-28T11:20:06.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33785
30232025-02-28T11:20:06.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33785 req_id = 12332fb6-6afb-4343-a951-07d60e285e37 response_code = 200 uri = /vpc-routes
30242025-02-28T11:20:06.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
30252025-02-28T11:20:06.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33785 req_id = 0bab7f27-5edf-4fef-b2ae-6880d75ce322 response_code = 204 uri = /eip-gateways
30262025-02-28T11:20:06.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33785 req_id = f2c2afd0-d256-43a7-91c1-d2d90aa4cc7c response_code = 204 uri = /vpc-routes
30272025-02-28T11:20:07.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64653
30282025-02-28T11:20:07.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64653 req_id = 026bb835-2870-4406-a039-34ce55b765e7 response_code = 200 uri = /vpc-routes
30292025-02-28T11:20:07.296ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 586e5b1c-fe84-4966-a99c-108aa56b2c5f values = ExternalIpGatewayMap { mappings: {} }
30302025-02-28T11:20:07.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64653 req_id = 94c48a33-278e-4ee0-af4a-2657157b9231 response_code = 204 uri = /eip-gateways
30312025-02-28T11:20:07.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64653 req_id = d26fc89c-368c-46b6-9c34-6b835cba9f40 response_code = 204 uri = /vpc-routes