Max level shown:
1 [ Jan 30 20:12:10 Enabled. ]
2 [ Jan 30 20:12:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 30 20:12:10 Method "start" exited with status 0. ]
4 [ Jan 30 20:12:10 Rereading configuration. ]
5 [ Jan 30 20:12:10 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-30T20:12:10.678ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-30T20:12:10.678ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-30T20:12:10.732ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-30T20:12:10.732ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-30T20:12:10.847ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-30T20:12:10.857ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-30T20:12:10.865ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-30T20:12:11.471ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-30T20:12:11.611ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-30T20:12:11.611ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-30T20:12:11.611ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-30T20:12:11.612ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-30T20:12:11.612ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-30T20:12:11.612ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-30T20:12:11.615ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-30T20:12:11.615ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-30T20:12:11.615ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-30T20:12:11.615ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-30T20:12:11.615ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-30T20:12:11.615ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-30T20:12:11.615ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-30T20:12:11.615ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-30T20:12:11.615ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-30T20:12:11.627ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-30T20:12:11.627ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool)
322025-01-30T20:12:11.725ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal }
332025-01-30T20:12:12.092ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-30T20:12:12.092ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-30T20:12:12.092ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-30T20:12:12.092ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-30T20:12:12.092ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-30T20:12:12.092ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-30T20:12:12.092ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-30T20:12:12.100ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-30T20:12:12.100ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool)
422025-01-30T20:12:12.185ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal }
432025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-30T20:12:12.540ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-30T20:12:12.540ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-30T20:12:12.540ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-30T20:12:12.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-30T20:12:12.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-30T20:12:12.540ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-30T20:12:12.541ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-30T20:12:12.541ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-30T20:12:12.541ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-30T20:12:12.541ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-30T20:12:12.541ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-30T20:12:12.541ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-30T20:12:12.541ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-30T20:12:12.541ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-30T20:12:12.541ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-30T20:12:12.552ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:715
1132025-01-30T20:12:12.552ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2484, tv_nsec: 346962435 } time_to_next_cleanup = 599.999921148s
1142025-01-30T20:12:12.552ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3936
1152025-01-30T20:12:12.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-30T20:12:12.552ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-30T20:12:12.552ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-30T20:12:12.555ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-30T20:12:12.557ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-30T20:12:12.557ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-01-30T20:12:12.557ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-30T20:12:12.557ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-30T20:12:12.558ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-30T20:12:12.558ZINFOSledAgent (RSS): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-30T20:12:12.558ZINFOSledAgent (RSS): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-30T20:12:12.558ZINFOSledAgent (RSS): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-30T20:12:12.558ZINFOSledAgent (RSS): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-30T20:12:12.558ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-01-30T20:12:12.558ZINFOSledAgent (RSS): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-30T20:12:12.558ZINFOSledAgent (RSS): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-30T20:12:12.558ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-01-30T20:12:12.558ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-30T20:12:12.558ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-30T20:12:12.558ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-01-30T20:12:12.558ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-30T20:12:12.558ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-30T20:12:12.558ZINFOSledAgent (bootstore): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-30T20:12:12.558ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-30T20:12:12.558ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a (sled), rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-30T20:12:12.559ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4233
1412025-01-30T20:12:12.559ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4633
1422025-01-30T20:12:12.564ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-30T20:12:12.569ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-30T20:12:12.569ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-30T20:12:12.574ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-30T20:12:12.574ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-30T20:12:12.574ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:59590
1482025-01-30T20:12:12.575ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a (sled), rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-30T20:12:12.575ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-30T20:12:12.575ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-30T20:12:12.575ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572025-01-30T20:12:12.575ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-30T20:12:12.575ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-30T20:12:12.575ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-30T20:12:12.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-30T20:12:12.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-30T20:12:12.631ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-30T20:12:12.638ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1662025-01-30T20:12:12.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-30T20:12:12.638ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1682025-01-30T20:12:12.638ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-30T20:12:12.641ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 85.631882ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "32962265-553a-4d39-b9f3-2aee2356893d", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "32962265-553a-4d39-b9f3-2aee2356893d" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-30T20:12:12.651ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_9e3c9e96-a0f5-4329-bdf7-96327d1c5427/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-30T20:12:12.675ZINFOSledAgent: successfully created encrypted zvol: name="oxi_9e3c9e96-a0f5-4329-bdf7-96327d1c5427/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-30T20:12:12.675ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_9e3c9e96-a0f5-4329-bdf7-96327d1c5427/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-30T20:12:12.680ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1742025-01-30T20:12:12.680ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-30T20:12:12.680ZINFOSledAgent (BackingFs): Ensuring dataset oxi_9e3c9e96-a0f5-4329-bdf7-96327d1c5427/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-30T20:12:12.728ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-30T20:12:12.728ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 100.11208ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b996d4d6-8a08-4572-9dcf-79d8ba3c0fc8", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b996d4d6-8a08-4572-9dcf-79d8ba3c0fc8" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-30T20:12:12.748ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-30T20:12:12.830ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-30T20:12:12.831ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 204.681623ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "218037a3-e8f4-4293-af7b-99c716467164", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "218037a3-e8f4-4293-af7b-99c716467164" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-30T20:12:12.967ZINFOSledAgent (BackingFs): Mounting oxi_9e3c9e96-a0f5-4329-bdf7-96327d1c5427/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-30T20:12:12.981ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-30T20:12:12.981ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-30T20:12:12.981ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-30T20:12:12.981ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-30T20:12:13.036ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-30T20:12:13.036ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.855773ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b88a3b93-8334-45cb-b88f-49185e6bf1fc", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b88a3b93-8334-45cb-b88f-49185e6bf1fc" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-30T20:12:13.187ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-30T20:12:13.188ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.005982ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c52c62db-d5ff-4f5e-84dd-b298c5f0d35a", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c52c62db-d5ff-4f5e-84dd-b298c5f0d35a" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-30T20:12:13.311ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-30T20:12:13.312ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 345.616849ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c08e7b2f-5e88-48ed-9d59-ba25542984cb", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c08e7b2f-5e88-48ed-9d59-ba25542984cb" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-30T20:12:13.659ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-30T20:12:13.659ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 442.620692ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "11c21583-b959-4726-aad9-906cb0eb1d1b", "content-length": "124", "date": "Thu, 30 Jan 2025 20:12:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "11c21583-b959-4726-aad9-906cb0eb1d1b" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-30T20:12:13.710ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1952025-01-30T20:12:13.715ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:52655 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1962025-01-30T20:12:13.715ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1972025-01-30T20:12:13.715ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52655 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1982025-01-30T20:12:13.716ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 129.829525ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
1992025-01-30T20:12:13.717ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2002025-01-30T20:12:13.717ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2012025-01-30T20:12:13.717ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:899 underlay_address = fd00:1122:3344:101::1
2022025-01-30T20:12:13.717ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-30T20:12:13.847ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 495.6382ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2042025-01-30T20:12:14.103ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052025-01-30T20:12:14.345ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 574.405372ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2062025-01-30T20:12:14.921ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.388403588s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2072025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2653
2082025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2898
2092025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2523
2102025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2570
2112025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2979
2122025-01-30T20:12:16.333ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3024
2132025-01-30T20:12:16.335ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2823
2142025-01-30T20:12:16.336ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2564
2152025-01-30T20:12:16.337ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='300de065-cd3a-42d4-bd57-e6b665c77500'/> <propval type="astring" name="rack_id" value='6cd2152b-e0e7-4208-8446-3b1ba878a49f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe68:446c'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='6cd2152b-e0e7-4208-8446-3b1ba878a49f'/> <propval type="astring" name="sled_id" value='80be2cf5-c1f1-42e5-8353-289dd0bb621a'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='80be2cf5-c1f1-42e5-8353-289dd0bb621a'/> <propval type="astring" name="rack_uuid" value='6cd2152b-e0e7-4208-8446-3b1ba878a49f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='80be2cf5-c1f1-42e5-8353-289dd0bb621a'/> <propval type="astring" name="rack_uuid" value='6cd2152b-e0e7-4208-8446-3b1ba878a49f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-30T20:12:16.337ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-30T20:12:16.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.21688ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-30T20:12:16.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.729776ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-30T20:12:16.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 193.440946ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-30T20:12:17.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 339.927162ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-30T20:12:17.345ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.753467561s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2222025-01-30T20:12:17.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 687.63258ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-30T20:12:18.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.215956387s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-30T20:12:19.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 633.727771ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-30T20:12:20.099ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.852745475s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2262025-01-30T20:12:20.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.281750162s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2272025-01-30T20:12:22.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-01-30T20:12:22.305ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2292025-01-30T20:12:22.306ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2302025-01-30T20:12:22.306ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312025-01-30T20:12:22.306ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-01-30T20:12:22.306ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-30T20:12:22.306ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-30T20:12:22.306ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-01-30T20:12:22.306ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-01-30T20:12:22.306ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3936
2372025-01-30T20:12:22.510ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-01-30T20:12:22.510ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-01-30T20:12:22.510ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:59590
2402025-01-30T20:12:22.516ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4257 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412025-01-30T20:12:22.516ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4273
2422025-01-30T20:12:22.516ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432025-01-30T20:12:22.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60847
2442025-01-30T20:12:22.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-30T20:12:22.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-30T20:12:22.793ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-30T20:12:22.793ZINFOSledAgent (ServiceManager): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-30T20:12:22.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60847 req_id = edc66e17-0f1c-4e71-9916-ea5c0f8db280 response_code = 200 uri = /inventory
2492025-01-30T20:12:22.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55142
2502025-01-30T20:12:22.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55142 req_id = b03af7d5-eb92-48ec-b1ec-2656d63d9426 response_code = 200 uri = /sled-role
2512025-01-30T20:12:22.854ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0da7cdc6-2311-4117-8ddf-df43de7e1374 (physical_disk), pool_id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 483a3ee9-7724-45d1-9508-da3ef718a0a1 (physical_disk), pool_id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 6750400a-207d-4f26-9baf-06b11d3a51e9 (physical_disk), pool_id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 721df6bb-9e4d-4e59-893b-b74387e4dd24 (physical_disk), pool_id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 956023d4-ac7e-476a-b45b-3eb32a39ec66 (physical_disk), pool_id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bce7d424-6fe9-4008-a499-c4fd4d0e0468 (physical_disk), pool_id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d4322621-ecac-49e6-9144-662719124731 (physical_disk), pool_id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ddf8bb19-7512-4e26-9e6a-7554335f992f (physical_disk), pool_id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e1b0b315-162b-4849-9ef6-2582715f493b (physical_disk), pool_id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522025-01-30T20:12:22.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58382
2532025-01-30T20:12:22.854ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:891 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2542025-01-30T20:12:22.854ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0da7cdc6-2311-4117-8ddf-df43de7e1374 (physical_disk), pool_id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 483a3ee9-7724-45d1-9508-da3ef718a0a1 (physical_disk), pool_id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 6750400a-207d-4f26-9baf-06b11d3a51e9 (physical_disk), pool_id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 721df6bb-9e4d-4e59-893b-b74387e4dd24 (physical_disk), pool_id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 956023d4-ac7e-476a-b45b-3eb32a39ec66 (physical_disk), pool_id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bce7d424-6fe9-4008-a499-c4fd4d0e0468 (physical_disk), pool_id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d4322621-ecac-49e6-9144-662719124731 (physical_disk), pool_id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ddf8bb19-7512-4e26-9e6a-7554335f992f (physical_disk), pool_id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: e1b0b315-162b-4849-9ef6-2582715f493b (physical_disk), pool_id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552025-01-30T20:12:22.854ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562025-01-30T20:12:22.855ZINFOSledAgent (StorageManager): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-01-30T20:12:22.855ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582025-01-30T20:12:22.855ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592025-01-30T20:12:22.855ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602025-01-30T20:12:22.855ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612025-01-30T20:12:22.855ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622025-01-30T20:12:23.023ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632025-01-30T20:12:23.023ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 267308a4-806f-4489-9002-d2fdc6345ade (zpool)
2642025-01-30T20:12:23.470ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2652025-01-30T20:12:23.683ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2662025-01-30T20:12:23.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2672025-01-30T20:12:23.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
2682025-01-30T20:12:23.727ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }
2692025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752025-01-30T20:12:23.735ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762025-01-30T20:12:23.771ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772025-01-30T20:12:23.778ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_267308a4-806f-4489-9002-d2fdc6345ade/crypt/zone file = sled-storage/src/dataset.rs:302
2782025-01-30T20:12:23.913ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_267308a4-806f-4489-9002-d2fdc6345ade file = sled-storage/src/dataset.rs:388
2792025-01-30T20:12:23.921ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802025-01-30T20:12:23.921ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812025-01-30T20:12:23.921ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822025-01-30T20:12:23.921ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832025-01-30T20:12:23.921ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842025-01-30T20:12:23.931ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852025-01-30T20:12:23.931ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool)
2862025-01-30T20:12:24.019ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }
2872025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932025-01-30T20:12:24.026ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942025-01-30T20:12:24.061ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952025-01-30T20:12:24.068ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone file = sled-storage/src/dataset.rs:302
2962025-01-30T20:12:24.205ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2 file = sled-storage/src/dataset.rs:388
2972025-01-30T20:12:24.212ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982025-01-30T20:12:24.212ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992025-01-30T20:12:24.212ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002025-01-30T20:12:24.212ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012025-01-30T20:12:24.212ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022025-01-30T20:12:24.222ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032025-01-30T20:12:24.222ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7414a064-4217-4398-b36a-c06130bcb569 (zpool)
3042025-01-30T20:12:24.307ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }
3052025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112025-01-30T20:12:24.314ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122025-01-30T20:12:24.344ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132025-01-30T20:12:24.351ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone file = sled-storage/src/dataset.rs:302
3142025-01-30T20:12:24.473ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
3152025-01-30T20:12:24.476ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7414a064-4217-4398-b36a-c06130bcb569 file = sled-storage/src/dataset.rs:388
3162025-01-30T20:12:24.483ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172025-01-30T20:12:24.483ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182025-01-30T20:12:24.483ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192025-01-30T20:12:24.483ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202025-01-30T20:12:24.483ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212025-01-30T20:12:24.492ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222025-01-30T20:12:24.492ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool)
3232025-01-30T20:12:24.577ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }
3242025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3252025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3262025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3272025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3282025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302025-01-30T20:12:24.584ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3312025-01-30T20:12:24.616ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322025-01-30T20:12:24.623ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone file = sled-storage/src/dataset.rs:302
3332025-01-30T20:12:24.750ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d file = sled-storage/src/dataset.rs:388
3342025-01-30T20:12:24.757ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352025-01-30T20:12:24.757ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362025-01-30T20:12:24.757ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372025-01-30T20:12:24.757ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382025-01-30T20:12:24.757ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392025-01-30T20:12:24.765ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402025-01-30T20:12:24.765ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool)
3412025-01-30T20:12:24.853ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }
3422025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482025-01-30T20:12:24.862ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492025-01-30T20:12:24.897ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502025-01-30T20:12:24.905ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone file = sled-storage/src/dataset.rs:302
3512025-01-30T20:12:25.036ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad file = sled-storage/src/dataset.rs:388
3522025-01-30T20:12:25.043ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532025-01-30T20:12:25.043ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542025-01-30T20:12:25.043ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552025-01-30T20:12:25.043ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562025-01-30T20:12:25.043ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572025-01-30T20:12:25.053ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582025-01-30T20:12:25.053ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool)
3592025-01-30T20:12:25.149ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }
3602025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662025-01-30T20:12:25.157ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672025-01-30T20:12:25.191ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682025-01-30T20:12:25.199ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone file = sled-storage/src/dataset.rs:302
3692025-01-30T20:12:25.334ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e file = sled-storage/src/dataset.rs:388
3702025-01-30T20:12:25.342ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712025-01-30T20:12:25.342ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722025-01-30T20:12:25.342ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732025-01-30T20:12:25.342ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742025-01-30T20:12:25.342ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752025-01-30T20:12:25.352ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762025-01-30T20:12:25.352ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool)
3772025-01-30T20:12:25.445ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }
3782025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842025-01-30T20:12:25.452ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852025-01-30T20:12:25.474ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
3862025-01-30T20:12:25.487ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872025-01-30T20:12:25.495ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone file = sled-storage/src/dataset.rs:302
3882025-01-30T20:12:25.632ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f file = sled-storage/src/dataset.rs:388
3892025-01-30T20:12:25.639ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902025-01-30T20:12:25.639ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912025-01-30T20:12:25.640ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922025-01-30T20:12:25.640ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932025-01-30T20:12:25.640ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942025-01-30T20:12:25.649ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952025-01-30T20:12:25.650ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool)
3962025-01-30T20:12:25.740ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }
3972025-01-30T20:12:25.747ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982025-01-30T20:12:25.747ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992025-01-30T20:12:25.747ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002025-01-30T20:12:25.747ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012025-01-30T20:12:25.747ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-01-30T20:12:25.748ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032025-01-30T20:12:25.748ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042025-01-30T20:12:25.783ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052025-01-30T20:12:25.790ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone file = sled-storage/src/dataset.rs:302
4062025-01-30T20:12:25.921ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 file = sled-storage/src/dataset.rs:388
4072025-01-30T20:12:25.928ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082025-01-30T20:12:25.928ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092025-01-30T20:12:25.928ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102025-01-30T20:12:25.928ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112025-01-30T20:12:25.928ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122025-01-30T20:12:25.938ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132025-01-30T20:12:25.938ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e04f8928-4530-4288-b470-e4b4780b8353 (zpool)
4142025-01-30T20:12:26.033ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }
4152025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212025-01-30T20:12:26.041ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222025-01-30T20:12:26.076ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232025-01-30T20:12:26.084ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone file = sled-storage/src/dataset.rs:302
4242025-01-30T20:12:26.224ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e04f8928-4530-4288-b470-e4b4780b8353 file = sled-storage/src/dataset.rs:388
4252025-01-30T20:12:26.232ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262025-01-30T20:12:26.232ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272025-01-30T20:12:26.232ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282025-01-30T20:12:26.232ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e3c9e96-a0f5-4329-bdf7-96327d1c5427 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19eaa796-af5f-4483-a2b4-768d577d90e1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292025-01-30T20:12:26.232ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302025-01-30T20:12:26.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312025-01-30T20:12:26.232ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-30T20:12:26.232ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:895 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4332025-01-30T20:12:26.232ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342025-01-30T20:12:26.232ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:921 generation = Generation(2) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4352025-01-30T20:12:26.232ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:926 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4362025-01-30T20:12:26.232ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:931 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4372025-01-30T20:12:26.232ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4382025-01-30T20:12:26.232ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:937 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4392025-01-30T20:12:26.232ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402025-01-30T20:12:26.233ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:942 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4412025-01-30T20:12:26.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3378452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58382 req_id = a74723b2-3f26-47c9-ae51-9139c9a56acf response_code = 200 uri = /omicron-physical-disks
4422025-01-30T20:12:26.264ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0441e527-e4db-4810-a9f7-f534149b6aaa (dataset): DatasetConfig { id: 0441e527-e4db-4810-a9f7-f534149b6aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06684185-b0e3-4dda-9710-48c1a10d94a2 (dataset): DatasetConfig { id: 06684185-b0e3-4dda-9710-48c1a10d94a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08364d3f-2999-494e-b982-6523c074ea52 (dataset): DatasetConfig { id: 08364d3f-2999-494e-b982-6523c074ea52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a6e9d77-2c34-4081-a46c-ade445003f87 (dataset): DatasetConfig { id: 0a6e9d77-2c34-4081-a46c-ade445003f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10be7b81-2054-4fa2-a000-2811a4545279 (dataset): DatasetConfig { id: 10be7b81-2054-4fa2-a000-2811a4545279 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10dce8e1-8a4a-4950-973c-04d0f09c6f0f (dataset): DatasetConfig { id: 10dce8e1-8a4a-4950-973c-04d0f09c6f0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1485773d-151b-496d-877b-09d0b2b06848 (dataset): DatasetConfig { id: 1485773d-151b-496d-877b-09d0b2b06848 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16d5c9d7-d5ec-4ce5-8baa-8c3964db9b3f (dataset): DatasetConfig { id: 16d5c9d7-d5ec-4ce5-8baa-8c3964db9b3f (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18044c20-461e-49f9-bba4-eca155f22124 (dataset): DatasetConfig { id: 18044c20-461e-49f9-bba4-eca155f22124 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c6996a9-3bb1-4825-8834-b79f8fdb8444 (dataset): DatasetConfig { id: 1c6996a9-3bb1-4825-8834-b79f8fdb8444 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29ef27eb-232b-4ef1-a74f-357cb554804a (dataset): DatasetConfig { id: 29ef27eb-232b-4ef1-a74f-357cb554804a (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fc297be-62f6-4220-a378-91e69a04c436 (dataset): DatasetConfig { id: 2fc297be-62f6-4220-a378-91e69a04c436 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30530a12-bf97-42c1-98fa-c1bdfd506dbc (dataset): DatasetConfig { id: 30530a12-bf97-42c1-98fa-c1bdfd506dbc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 345c475b-2575-4786-bc9b-b20a53c15157 (dataset): DatasetConfig { id: 345c475b-2575-4786-bc9b-b20a53c15157 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35420e66-84df-48a3-bb6e-5b9c325d4948 (dataset): DatasetConfig { id: 35420e66-84df-48a3-bb6e-5b9c325d4948 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35eded37-fb50-4363-b3f3-0f809cf5e81a (dataset): DatasetConfig { id: 35eded37-fb50-4363-b3f3-0f809cf5e81a (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 38498385-0669-4e9f-95e1-487d91c48105 (dataset): DatasetConfig { id: 38498385-0669-4e9f-95e1-487d91c48105 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39ca4ba7-26e4-4441-a813-7f0005817402 (dataset): DatasetConfig { id: 39ca4ba7-26e4-4441-a813-7f0005817402 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a270b47-fb4f-4e72-bb5a-b19f719344b1 (dataset): DatasetConfig { id: 3a270b47-fb4f-4e72-bb5a-b19f719344b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a91074d-9f14-4f41-b37b-324a6cb3ce61 (dataset): DatasetConfig { id: 3a91074d-9f14-4f41-b37b-324a6cb3ce61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42734434-e000-46f9-9ece-32859626e179 (dataset): DatasetConfig { id: 42734434-e000-46f9-9ece-32859626e179 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 456590ad-9ba6-4b57-92a5-295d459c6306 (dataset): DatasetConfig { id: 456590ad-9ba6-4b57-92a5-295d459c6306 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46348260-41dd-4680-8c17-a3c37238fbf3 (dataset): DatasetConfig { id: 46348260-41dd-4680-8c17-a3c37238fbf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4690b41b-4725-4a4d-bdcb-349ce4f71339 (dataset): DatasetConfig { id: 4690b41b-4725-4a4d-bdcb-349ce4f71339 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fc39dfb-3ae3-4ee8-a8ab-da8878ee7ce1 (dataset): DatasetConfig { id: 4fc39dfb-3ae3-4ee8-a8ab-da8878ee7ce1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55f783e0-3ef7-481a-a8b3-7561147e560a (dataset): DatasetConfig { id: 55f783e0-3ef7-481a-a8b3-7561147e560a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57a43e57-78aa-4cb5-b681-536511af5812 (dataset): DatasetConfig { id: 57a43e57-78aa-4cb5-b681-536511af5812 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 598d75bf-412d-40f4-995b-a358256ef2df (dataset): DatasetConfig { id: 598d75bf-412d-40f4-995b-a358256ef2df (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a4f0e49-76f0-4e61-9ee2-3b4b2a7d40f6 (dataset): DatasetConfig { id: 5a4f0e49-76f0-4e61-9ee2-3b4b2a7d40f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb48162-19c2-4337-81fa-2b2d956486b7 (dataset): DatasetConfig { id: 5cb48162-19c2-4337-81fa-2b2d956486b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eb16eb1-6c4d-4318-ac81-415207d7f729 (dataset): DatasetConfig { id: 5eb16eb1-6c4d-4318-ac81-415207d7f729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6273ddca-c28f-41fd-961c-15f95bda0277 (dataset): DatasetConfig { id: 6273ddca-c28f-41fd-961c-15f95bda0277 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6293dd9d-6ee4-4279-9e61-1fbcf864dc58 (dataset): DatasetConfig { id: 6293dd9d-6ee4-4279-9e61-1fbcf864dc58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69d98de4-9a92-4563-adfe-21e57b560332 (dataset): DatasetConfig { id: 69d98de4-9a92-4563-adfe-21e57b560332 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b1c791e-eabe-4bc2-8b42-96a3682c3b4f (dataset): DatasetConfig { id: 7b1c791e-eabe-4bc2-8b42-96a3682c3b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f09e630-a09e-4828-860f-9be56bb07457 (dataset): DatasetConfig { id: 7f09e630-a09e-4828-860f-9be56bb07457 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8334d7bd-3f5d-4242-8430-008484c66b12 (dataset): DatasetConfig { id: 8334d7bd-3f5d-4242-8430-008484c66b12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dd6b6cc-06f0-46d6-959f-6d61f77f677d (dataset): DatasetConfig { id: 8dd6b6cc-06f0-46d6-959f-6d61f77f677d (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90f1ac20-cce0-412f-8b86-b38c04463434 (dataset): DatasetConfig { id: 90f1ac20-cce0-412f-8b86-b38c04463434 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95cb57a9-b51e-4176-8a92-772eebd4553f (dataset): DatasetConfig { id: 95cb57a9-b51e-4176-8a92-772eebd4553f (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cb77cc7-a8f2-432d-908e-05c13cbb361d (dataset): DatasetConfig { id: 9cb77cc7-a8f2-432d-908e-05c13cbb361d (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3fcc4bb-5f0c-4023-b0bf-0274aea50286 (dataset): DatasetConfig { id: a3fcc4bb-5f0c-4023-b0bf-0274aea50286 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa9bcb24-8329-4096-9cda-4534c20c1ba8 (dataset): DatasetConfig { id: aa9bcb24-8329-4096-9cda-4534c20c1ba8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac63a3d9-ec72-4d5e-b18f-87435cc49160 (dataset): DatasetConfig { id: ac63a3d9-ec72-4d5e-b18f-87435cc49160 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af424db4-8748-49ad-b115-9f78e8a5fbc8 (dataset): DatasetConfig { id: af424db4-8748-49ad-b115-9f78e8a5fbc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1410441-2f99-4941-ba09-b86690808d04 (dataset): DatasetConfig { id: b1410441-2f99-4941-ba09-b86690808d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b447eecd-063b-4405-a0b5-8a5ee19c634a (dataset): DatasetConfig { id: b447eecd-063b-4405-a0b5-8a5ee19c634a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc6480c-7c3e-416d-901d-37db08b99307 (dataset): DatasetConfig { id: bcc6480c-7c3e-416d-901d-37db08b99307 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1ee1a02-938a-4382-8df3-666539972964 (dataset): DatasetConfig { id: c1ee1a02-938a-4382-8df3-666539972964 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2254f8b-bcae-4fe3-b11e-4396bccbd8a1 (dataset): DatasetConfig { id: c2254f8b-bcae-4fe3-b11e-4396bccbd8a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2cdeda5-91cd-41ff-acf6-1dbe2d778c3b (dataset): DatasetConfig { id: c2cdeda5-91cd-41ff-acf6-1dbe2d778c3b (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c30ea6d3-a629-45fb-830d-4edf536cc65f (dataset): DatasetConfig { id: c30ea6d3-a629-45fb-830d-4edf536cc65f (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c634acba-8896-4cb1-9eef-f43574bf88cf (dataset): DatasetConfig { id: c634acba-8896-4cb1-9eef-f43574bf88cf (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cadbac09-8505-46d2-8f2a-c7ce5de92233 (dataset): DatasetConfig { id: cadbac09-8505-46d2-8f2a-c7ce5de92233 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9aaf07-4deb-4324-90a9-c31fd9e17773 (dataset): DatasetConfig { id: cc9aaf07-4deb-4324-90a9-c31fd9e17773 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf077e73-2aa0-445e-96ab-54eca156621c (dataset): DatasetConfig { id: cf077e73-2aa0-445e-96ab-54eca156621c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d39e56c2-e49e-4e33-a719-3dec4a62f626 (dataset): DatasetConfig { id: d39e56c2-e49e-4e33-a719-3dec4a62f626 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4331dc5-5c47-43bf-9581-5fb53b2005ff (dataset): DatasetConfig { id: d4331dc5-5c47-43bf-9581-5fb53b2005ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d433a06f-f418-40fb-98e9-dd607f7b79ba (dataset): DatasetConfig { id: d433a06f-f418-40fb-98e9-dd607f7b79ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daf4680a-8bab-4aba-ac0f-9d4a2bb6a1c9 (dataset): DatasetConfig { id: daf4680a-8bab-4aba-ac0f-9d4a2bb6a1c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc9443c2-18c2-4c32-9d97-498735f7a3a0 (dataset): DatasetConfig { id: dc9443c2-18c2-4c32-9d97-498735f7a3a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb80996-5339-4496-ae44-f8719ec07862 (dataset): DatasetConfig { id: ddb80996-5339-4496-ae44-f8719ec07862 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e93414fe-e787-44ef-8a6d-c888f829585e (dataset): DatasetConfig { id: e93414fe-e787-44ef-8a6d-c888f829585e (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4ae059d-f9e1-4462-b296-d33f10e114ad (dataset): DatasetConfig { id: f4ae059d-f9e1-4462-b296-d33f10e114ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f50b8e49-842c-44c3-a0b0-e230bbb26b60 (dataset): DatasetConfig { id: f50b8e49-842c-44c3-a0b0-e230bbb26b60 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f905c867-e02c-42c1-b2f6-40128206ed31 (dataset): DatasetConfig { id: f905c867-e02c-42c1-b2f6-40128206ed31 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432025-01-30T20:12:26.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44931
4442025-01-30T20:12:26.264ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:857 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4452025-01-30T20:12:26.265ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0441e527-e4db-4810-a9f7-f534149b6aaa (dataset): DatasetConfig { id: 0441e527-e4db-4810-a9f7-f534149b6aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06684185-b0e3-4dda-9710-48c1a10d94a2 (dataset): DatasetConfig { id: 06684185-b0e3-4dda-9710-48c1a10d94a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08364d3f-2999-494e-b982-6523c074ea52 (dataset): DatasetConfig { id: 08364d3f-2999-494e-b982-6523c074ea52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a6e9d77-2c34-4081-a46c-ade445003f87 (dataset): DatasetConfig { id: 0a6e9d77-2c34-4081-a46c-ade445003f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10be7b81-2054-4fa2-a000-2811a4545279 (dataset): DatasetConfig { id: 10be7b81-2054-4fa2-a000-2811a4545279 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10dce8e1-8a4a-4950-973c-04d0f09c6f0f (dataset): DatasetConfig { id: 10dce8e1-8a4a-4950-973c-04d0f09c6f0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1485773d-151b-496d-877b-09d0b2b06848 (dataset): DatasetConfig { id: 1485773d-151b-496d-877b-09d0b2b06848 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16d5c9d7-d5ec-4ce5-8baa-8c3964db9b3f (dataset): DatasetConfig { id: 16d5c9d7-d5ec-4ce5-8baa-8c3964db9b3f (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18044c20-461e-49f9-bba4-eca155f22124 (dataset): DatasetConfig { id: 18044c20-461e-49f9-bba4-eca155f22124 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c6996a9-3bb1-4825-8834-b79f8fdb8444 (dataset): DatasetConfig { id: 1c6996a9-3bb1-4825-8834-b79f8fdb8444 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29ef27eb-232b-4ef1-a74f-357cb554804a (dataset): DatasetConfig { id: 29ef27eb-232b-4ef1-a74f-357cb554804a (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2fc297be-62f6-4220-a378-91e69a04c436 (dataset): DatasetConfig { id: 2fc297be-62f6-4220-a378-91e69a04c436 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30530a12-bf97-42c1-98fa-c1bdfd506dbc (dataset): DatasetConfig { id: 30530a12-bf97-42c1-98fa-c1bdfd506dbc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 345c475b-2575-4786-bc9b-b20a53c15157 (dataset): DatasetConfig { id: 345c475b-2575-4786-bc9b-b20a53c15157 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35420e66-84df-48a3-bb6e-5b9c325d4948 (dataset): DatasetConfig { id: 35420e66-84df-48a3-bb6e-5b9c325d4948 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35eded37-fb50-4363-b3f3-0f809cf5e81a (dataset): DatasetConfig { id: 35eded37-fb50-4363-b3f3-0f809cf5e81a (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 38498385-0669-4e9f-95e1-487d91c48105 (dataset): DatasetConfig { id: 38498385-0669-4e9f-95e1-487d91c48105 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39ca4ba7-26e4-4441-a813-7f0005817402 (dataset): DatasetConfig { id: 39ca4ba7-26e4-4441-a813-7f0005817402 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a270b47-fb4f-4e72-bb5a-b19f719344b1 (dataset): DatasetConfig { id: 3a270b47-fb4f-4e72-bb5a-b19f719344b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a91074d-9f14-4f41-b37b-324a6cb3ce61 (dataset): DatasetConfig { id: 3a91074d-9f14-4f41-b37b-324a6cb3ce61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42734434-e000-46f9-9ece-32859626e179 (dataset): DatasetConfig { id: 42734434-e000-46f9-9ece-32859626e179 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 456590ad-9ba6-4b57-92a5-295d459c6306 (dataset): DatasetConfig { id: 456590ad-9ba6-4b57-92a5-295d459c6306 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 46348260-41dd-4680-8c17-a3c37238fbf3 (dataset): DatasetConfig { id: 46348260-41dd-4680-8c17-a3c37238fbf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4690b41b-4725-4a4d-bdcb-349ce4f71339 (dataset): DatasetConfig { id: 4690b41b-4725-4a4d-bdcb-349ce4f71339 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fc39dfb-3ae3-4ee8-a8ab-da8878ee7ce1 (dataset): DatasetConfig { id: 4fc39dfb-3ae3-4ee8-a8ab-da8878ee7ce1 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55f783e0-3ef7-481a-a8b3-7561147e560a (dataset): DatasetConfig { id: 55f783e0-3ef7-481a-a8b3-7561147e560a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57a43e57-78aa-4cb5-b681-536511af5812 (dataset): DatasetConfig { id: 57a43e57-78aa-4cb5-b681-536511af5812 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 598d75bf-412d-40f4-995b-a358256ef2df (dataset): DatasetConfig { id: 598d75bf-412d-40f4-995b-a358256ef2df (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a4f0e49-76f0-4e61-9ee2-3b4b2a7d40f6 (dataset): DatasetConfig { id: 5a4f0e49-76f0-4e61-9ee2-3b4b2a7d40f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb48162-19c2-4337-81fa-2b2d956486b7 (dataset): DatasetConfig { id: 5cb48162-19c2-4337-81fa-2b2d956486b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eb16eb1-6c4d-4318-ac81-415207d7f729 (dataset): DatasetConfig { id: 5eb16eb1-6c4d-4318-ac81-415207d7f729 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6273ddca-c28f-41fd-961c-15f95bda0277 (dataset): DatasetConfig { id: 6273ddca-c28f-41fd-961c-15f95bda0277 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6293dd9d-6ee4-4279-9e61-1fbcf864dc58 (dataset): DatasetConfig { id: 6293dd9d-6ee4-4279-9e61-1fbcf864dc58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69d98de4-9a92-4563-adfe-21e57b560332 (dataset): DatasetConfig { id: 69d98de4-9a92-4563-adfe-21e57b560332 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b1c791e-eabe-4bc2-8b42-96a3682c3b4f (dataset): DatasetConfig { id: 7b1c791e-eabe-4bc2-8b42-96a3682c3b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f09e630-a09e-4828-860f-9be56bb07457 (dataset): DatasetConfig { id: 7f09e630-a09e-4828-860f-9be56bb07457 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8334d7bd-3f5d-4242-8430-008484c66b12 (dataset): DatasetConfig { id: 8334d7bd-3f5d-4242-8430-008484c66b12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dd6b6cc-06f0-46d6-959f-6d61f77f677d (dataset): DatasetConfig { id: 8dd6b6cc-06f0-46d6-959f-6d61f77f677d (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90f1ac20-cce0-412f-8b86-b38c04463434 (dataset): DatasetConfig { id: 90f1ac20-cce0-412f-8b86-b38c04463434 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 95cb57a9-b51e-4176-8a92-772eebd4553f (dataset): DatasetConfig { id: 95cb57a9-b51e-4176-8a92-772eebd4553f (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cb77cc7-a8f2-432d-908e-05c13cbb361d (dataset): DatasetConfig { id: 9cb77cc7-a8f2-432d-908e-05c13cbb361d (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3fcc4bb-5f0c-4023-b0bf-0274aea50286 (dataset): DatasetConfig { id: a3fcc4bb-5f0c-4023-b0bf-0274aea50286 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa9bcb24-8329-4096-9cda-4534c20c1ba8 (dataset): DatasetConfig { id: aa9bcb24-8329-4096-9cda-4534c20c1ba8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac63a3d9-ec72-4d5e-b18f-87435cc49160 (dataset): DatasetConfig { id: ac63a3d9-ec72-4d5e-b18f-87435cc49160 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af424db4-8748-49ad-b115-9f78e8a5fbc8 (dataset): DatasetConfig { id: af424db4-8748-49ad-b115-9f78e8a5fbc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1410441-2f99-4941-ba09-b86690808d04 (dataset): DatasetConfig { id: b1410441-2f99-4941-ba09-b86690808d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b447eecd-063b-4405-a0b5-8a5ee19c634a (dataset): DatasetConfig { id: b447eecd-063b-4405-a0b5-8a5ee19c634a (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc6480c-7c3e-416d-901d-37db08b99307 (dataset): DatasetConfig { id: bcc6480c-7c3e-416d-901d-37db08b99307 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1ee1a02-938a-4382-8df3-666539972964 (dataset): DatasetConfig { id: c1ee1a02-938a-4382-8df3-666539972964 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2254f8b-bcae-4fe3-b11e-4396bccbd8a1 (dataset): DatasetConfig { id: c2254f8b-bcae-4fe3-b11e-4396bccbd8a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2cdeda5-91cd-41ff-acf6-1dbe2d778c3b (dataset): DatasetConfig { id: c2cdeda5-91cd-41ff-acf6-1dbe2d778c3b (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c30ea6d3-a629-45fb-830d-4edf536cc65f (dataset): DatasetConfig { id: c30ea6d3-a629-45fb-830d-4edf536cc65f (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c634acba-8896-4cb1-9eef-f43574bf88cf (dataset): DatasetConfig { id: c634acba-8896-4cb1-9eef-f43574bf88cf (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cadbac09-8505-46d2-8f2a-c7ce5de92233 (dataset): DatasetConfig { id: cadbac09-8505-46d2-8f2a-c7ce5de92233 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9aaf07-4deb-4324-90a9-c31fd9e17773 (dataset): DatasetConfig { id: cc9aaf07-4deb-4324-90a9-c31fd9e17773 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cf077e73-2aa0-445e-96ab-54eca156621c (dataset): DatasetConfig { id: cf077e73-2aa0-445e-96ab-54eca156621c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d39e56c2-e49e-4e33-a719-3dec4a62f626 (dataset): DatasetConfig { id: d39e56c2-e49e-4e33-a719-3dec4a62f626 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4331dc5-5c47-43bf-9581-5fb53b2005ff (dataset): DatasetConfig { id: d4331dc5-5c47-43bf-9581-5fb53b2005ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d433a06f-f418-40fb-98e9-dd607f7b79ba (dataset): DatasetConfig { id: d433a06f-f418-40fb-98e9-dd607f7b79ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daf4680a-8bab-4aba-ac0f-9d4a2bb6a1c9 (dataset): DatasetConfig { id: daf4680a-8bab-4aba-ac0f-9d4a2bb6a1c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc9443c2-18c2-4c32-9d97-498735f7a3a0 (dataset): DatasetConfig { id: dc9443c2-18c2-4c32-9d97-498735f7a3a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb80996-5339-4496-ae44-f8719ec07862 (dataset): DatasetConfig { id: ddb80996-5339-4496-ae44-f8719ec07862 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e93414fe-e787-44ef-8a6d-c888f829585e (dataset): DatasetConfig { id: e93414fe-e787-44ef-8a6d-c888f829585e (dataset), name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4ae059d-f9e1-4462-b296-d33f10e114ad (dataset): DatasetConfig { id: f4ae059d-f9e1-4462-b296-d33f10e114ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f50b8e49-842c-44c3-a0b0-e230bbb26b60 (dataset): DatasetConfig { id: f50b8e49-842c-44c3-a0b0-e230bbb26b60 (dataset), name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f905c867-e02c-42c1-b2f6-40128206ed31 (dataset): DatasetConfig { id: f905c867-e02c-42c1-b2f6-40128206ed31 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462025-01-30T20:12:26.265ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-30T20:12:26.265ZINFOSledAgent (StorageManager): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482025-01-30T20:12:26.265ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492025-01-30T20:12:26.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502025-01-30T20:12:26.279ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512025-01-30T20:12:26.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3" } file = sled-storage/src/manager.rs:1431
4522025-01-30T20:12:26.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-30T20:12:26.337ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542025-01-30T20:12:26.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crucible" } file = sled-storage/src/manager.rs:1431
4552025-01-30T20:12:26.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-30T20:12:26.383ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-30T20:12:26.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone/oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f"), full_name: "oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone/oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f" } file = sled-storage/src/manager.rs:1431
4582025-01-30T20:12:26.439ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-30T20:12:26.439ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4602025-01-30T20:12:26.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/267308a4-806f-4489-9002-d2fdc6345ade/crypt/debug"), full_name: "oxp_267308a4-806f-4489-9002-d2fdc6345ade/crypt/debug" } file = sled-storage/src/manager.rs:1431
4612025-01-30T20:12:26.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-30T20:12:26.466ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-30T20:12:26.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone/oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291"), full_name: "oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone/oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291" } file = sled-storage/src/manager.rs:1431
4642025-01-30T20:12:26.477ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
4652025-01-30T20:12:26.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-30T20:12:26.523ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672025-01-30T20:12:26.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4682025-01-30T20:12:26.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-01-30T20:12:26.569ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4702025-01-30T20:12:26.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone"), full_name: "oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone" } file = sled-storage/src/manager.rs:1431
4712025-01-30T20:12:26.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-30T20:12:26.596ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732025-01-30T20:12:26.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crucible" } file = sled-storage/src/manager.rs:1431
4742025-01-30T20:12:26.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-01-30T20:12:26.641ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-01-30T20:12:26.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone/oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone/oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d" } file = sled-storage/src/manager.rs:1431
4772025-01-30T20:12:26.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-30T20:12:26.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792025-01-30T20:12:26.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4802025-01-30T20:12:26.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-30T20:12:26.754ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-01-30T20:12:26.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4" } file = sled-storage/src/manager.rs:1431
4832025-01-30T20:12:26.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-30T20:12:26.814ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-01-30T20:12:26.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crucible" } file = sled-storage/src/manager.rs:1431
4862025-01-30T20:12:26.863ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-30T20:12:26.863ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882025-01-30T20:12:26.863ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone" } file = sled-storage/src/manager.rs:1431
4892025-01-30T20:12:26.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-30T20:12:26.892ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912025-01-30T20:12:26.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2" } file = sled-storage/src/manager.rs:1431
4922025-01-30T20:12:26.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-30T20:12:26.948ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4942025-01-30T20:12:26.948ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/debug"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/debug" } file = sled-storage/src/manager.rs:1431
4952025-01-30T20:12:26.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-30T20:12:26.976ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4972025-01-30T20:12:26.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04f8928-4530-4288-b470-e4b4780b8353/crypt/debug"), full_name: "oxp_e04f8928-4530-4288-b470-e4b4780b8353/crypt/debug" } file = sled-storage/src/manager.rs:1431
4982025-01-30T20:12:27.003ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-30T20:12:27.003ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-30T20:12:27.003ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf" } file = sled-storage/src/manager.rs:1431
5012025-01-30T20:12:27.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-30T20:12:27.060ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-30T20:12:27.060ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_267308a4-806f-4489-9002-d2fdc6345ade/crucible" } file = sled-storage/src/manager.rs:1431
5042025-01-30T20:12:27.109ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-30T20:12:27.109ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-30T20:12:27.109ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396" } file = sled-storage/src/manager.rs:1431
5072025-01-30T20:12:27.168ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-30T20:12:27.168ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-30T20:12:27.168ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed" } file = sled-storage/src/manager.rs:1431
5102025-01-30T20:12:27.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-30T20:12:27.225ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5122025-01-30T20:12:27.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone" } file = sled-storage/src/manager.rs:1431
5132025-01-30T20:12:27.253ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-30T20:12:27.253ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5152025-01-30T20:12:27.253ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/debug"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/debug" } file = sled-storage/src/manager.rs:1431
5162025-01-30T20:12:27.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-30T20:12:27.281ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182025-01-30T20:12:27.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5192025-01-30T20:12:27.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-30T20:12:27.326ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5212025-01-30T20:12:27.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/267308a4-806f-4489-9002-d2fdc6345ade/crypt/zone"), full_name: "oxp_267308a4-806f-4489-9002-d2fdc6345ade/crypt/zone" } file = sled-storage/src/manager.rs:1431
5222025-01-30T20:12:27.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-30T20:12:27.354ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-30T20:12:27.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81" } file = sled-storage/src/manager.rs:1431
5252025-01-30T20:12:27.412ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-30T20:12:27.412ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-30T20:12:27.412ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c" } file = sled-storage/src/manager.rs:1431
5282025-01-30T20:12:27.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-30T20:12:27.472ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5302025-01-30T20:12:27.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/debug"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/debug" } file = sled-storage/src/manager.rs:1431
5312025-01-30T20:12:27.479ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
5322025-01-30T20:12:27.500ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-30T20:12:27.501ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-30T20:12:27.501ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e04f8928-4530-4288-b470-e4b4780b8353/crucible" } file = sled-storage/src/manager.rs:1431
5352025-01-30T20:12:27.547ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-30T20:12:27.547ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-30T20:12:27.547ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crucible" } file = sled-storage/src/manager.rs:1431
5382025-01-30T20:12:27.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-30T20:12:27.593ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-30T20:12:27.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5412025-01-30T20:12:27.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-30T20:12:27.643ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-01-30T20:12:27.643ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a" } file = sled-storage/src/manager.rs:1431
5442025-01-30T20:12:27.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-30T20:12:27.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-01-30T20:12:27.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crucible" } file = sled-storage/src/manager.rs:1431
5472025-01-30T20:12:27.750ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-30T20:12:27.750ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-30T20:12:27.750ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/267308a4-806f-4489-9002-d2fdc6345ade/crypt/zone/oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08"), full_name: "oxp_267308a4-806f-4489-9002-d2fdc6345ade/crypt/zone/oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08" } file = sled-storage/src/manager.rs:1431
5502025-01-30T20:12:27.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-30T20:12:27.809ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5522025-01-30T20:12:27.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone"), full_name: "oxp_e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone" } file = sled-storage/src/manager.rs:1431
5532025-01-30T20:12:27.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-30T20:12:27.837ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-30T20:12:27.837ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone/oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d"), full_name: "oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/zone/oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d" } file = sled-storage/src/manager.rs:1431
5562025-01-30T20:12:27.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-30T20:12:27.899ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-01-30T20:12:27.899ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone"), full_name: "oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5592025-01-30T20:12:27.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-30T20:12:27.927ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-30T20:12:27.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone/oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone/oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa" } file = sled-storage/src/manager.rs:1431
5622025-01-30T20:12:27.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-30T20:12:27.986ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-30T20:12:27.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5652025-01-30T20:12:28.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-30T20:12:28.039ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5672025-01-30T20:12:28.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/debug"), full_name: "oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5682025-01-30T20:12:28.067ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-30T20:12:28.067ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-30T20:12:28.067ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b" } file = sled-storage/src/manager.rs:1431
5712025-01-30T20:12:28.126ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-30T20:12:28.126ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-01-30T20:12:28.126ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone/oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a"), full_name: "oxp_e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone/oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a" } file = sled-storage/src/manager.rs:1431
5742025-01-30T20:12:28.187ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752025-01-30T20:12:28.187ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762025-01-30T20:12:28.187ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34" } file = sled-storage/src/manager.rs:1431
5772025-01-30T20:12:28.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782025-01-30T20:12:28.247ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792025-01-30T20:12:28.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5802025-01-30T20:12:28.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812025-01-30T20:12:28.297ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822025-01-30T20:12:28.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde" } file = sled-storage/src/manager.rs:1431
5832025-01-30T20:12:28.359ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-30T20:12:28.359ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-01-30T20:12:28.359ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5862025-01-30T20:12:28.408ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-30T20:12:28.408ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882025-01-30T20:12:28.408ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f" } file = sled-storage/src/manager.rs:1431
5892025-01-30T20:12:28.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-30T20:12:28.469ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912025-01-30T20:12:28.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5922025-01-30T20:12:28.482ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
5932025-01-30T20:12:28.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-30T20:12:28.518ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-30T20:12:28.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5962025-01-30T20:12:28.567ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-30T20:12:28.567ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982025-01-30T20:12:28.567ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5992025-01-30T20:12:28.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-30T20:12:28.619ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-30T20:12:28.619ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/zone/oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a" } file = sled-storage/src/manager.rs:1431
6022025-01-30T20:12:28.679ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-01-30T20:12:28.679ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042025-01-30T20:12:28.679ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248" } file = sled-storage/src/manager.rs:1431
6052025-01-30T20:12:28.740ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-30T20:12:28.740ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072025-01-30T20:12:28.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6082025-01-30T20:12:28.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-30T20:12:28.789ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-30T20:12:28.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crucible" } file = sled-storage/src/manager.rs:1431
6112025-01-30T20:12:28.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-30T20:12:28.837ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132025-01-30T20:12:28.837ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crucible" } file = sled-storage/src/manager.rs:1431
6142025-01-30T20:12:28.885ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-30T20:12:28.885ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6162025-01-30T20:12:28.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/debug"), full_name: "oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/debug" } file = sled-storage/src/manager.rs:1431
6172025-01-30T20:12:28.914ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-30T20:12:28.914ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6192025-01-30T20:12:28.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/debug"), full_name: "oxp_7414a064-4217-4398-b36a-c06130bcb569/crypt/debug" } file = sled-storage/src/manager.rs:1431
6202025-01-30T20:12:28.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-30T20:12:28.944ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-30T20:12:28.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone/oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc" } file = sled-storage/src/manager.rs:1431
6232025-01-30T20:12:29.003ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-30T20:12:29.003ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6252025-01-30T20:12:29.003ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/debug"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/debug" } file = sled-storage/src/manager.rs:1431
6262025-01-30T20:12:29.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-30T20:12:29.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282025-01-30T20:12:29.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf" } file = sled-storage/src/manager.rs:1431
6292025-01-30T20:12:29.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-30T20:12:29.090ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6312025-01-30T20:12:29.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone" } file = sled-storage/src/manager.rs:1431
6322025-01-30T20:12:29.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-30T20:12:29.121ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-01-30T20:12:29.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone/oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f"), full_name: "oxp_e04f8928-4530-4288-b470-e4b4780b8353/crypt/zone/oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f" } file = sled-storage/src/manager.rs:1431
6352025-01-30T20:12:29.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-30T20:12:29.181ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-30T20:12:29.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0"), full_name: "oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/zone/oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0" } file = sled-storage/src/manager.rs:1431
6382025-01-30T20:12:29.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392025-01-30T20:12:29.243ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402025-01-30T20:12:29.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone"), full_name: "oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/zone" } file = sled-storage/src/manager.rs:1431
6412025-01-30T20:12:29.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422025-01-30T20:12:29.273ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6432025-01-30T20:12:29.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone"), full_name: "oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/zone" } file = sled-storage/src/manager.rs:1431
6442025-01-30T20:12:29.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452025-01-30T20:12:29.303ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6462025-01-30T20:12:29.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone/oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28"), full_name: "oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/zone/oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28" } file = sled-storage/src/manager.rs:1431
6472025-01-30T20:12:29.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482025-01-30T20:12:29.364ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492025-01-30T20:12:29.364ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343"), full_name: "oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/zone/oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343" } file = sled-storage/src/manager.rs:1431
6502025-01-30T20:12:29.424ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-30T20:12:29.425ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-30T20:12:29.425ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:859 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6532025-01-30T20:12:29.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3161004 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44931 req_id = 5719faae-7c44-402f-8cb2-b7f6ec01396b response_code = 200 uri = /datasets
6542025-01-30T20:12:29.457ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 3e630c35-9e6f-4219-8e95-98b889a36f81 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d657c89-e0f4-4d06-8add-9d38e7aaaf34 (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 912f7b3b-f72d-4191-9a19-27e9c0d3675b (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-01-30T20:12:29.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63920
6562025-01-30T20:12:29.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-01-30T20:12:29.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-01-30T20:12:29.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-01-30T20:12:29.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-01-30T20:12:29.475ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-30T20:12:29.475ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-30T20:12:29.483ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6632025-01-30T20:12:29.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-01-30T20:12:29.484ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-30T20:12:29.484ZINFOSledAgent (ServiceManager): No ledger in /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:188
6662025-01-30T20:12:29.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-30T20:12:29.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-30T20:12:29.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-30T20:12:29.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-30T20:12:29.581ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81 file = illumos-utils/src/zone.rs:325
6712025-01-30T20:12:29.585ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b file = illumos-utils/src/zone.rs:325
6722025-01-30T20:12:29.589ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34 file = illumos-utils/src/zone.rs:325
6732025-01-30T20:12:29.601ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81 file = illumos-utils/src/zone.rs:363
6742025-01-30T20:12:29.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b file = illumos-utils/src/zone.rs:363
6752025-01-30T20:12:29.609ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34 file = illumos-utils/src/zone.rs:363
6762025-01-30T20:12:29.954ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 21.767250722s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6772025-01-30T20:12:30.486ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/probe_manager.rs:238 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6782025-01-30T20:12:31.275ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792025-01-30T20:12:31.275ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802025-01-30T20:12:31.275ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
6812025-01-30T20:12:31.760ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822025-01-30T20:12:31.761ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6832025-01-30T20:12:32.242ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842025-01-30T20:12:32.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 41.438445ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
6852025-01-30T20:12:32.249ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
6862025-01-30T20:12:32.252ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6872025-01-30T20:12:32.252ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
6882025-01-30T20:12:32.276ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6892025-01-30T20:12:32.276ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
6902025-01-30T20:12:32.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 55.968486ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
6912025-01-30T20:12:32.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 133.61016ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
6922025-01-30T20:12:32.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 29.426888ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
6932025-01-30T20:12:32.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 32.543519ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
6942025-01-30T20:12:32.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 58.823616ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
6952025-01-30T20:12:32.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 135.258179ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
6962025-01-30T20:12:32.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 153.383748ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
6972025-01-30T20:12:32.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 176.206377ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
6982025-01-30T20:12:32.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 218.448401ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
6992025-01-30T20:12:32.719ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4281
7002025-01-30T20:12:32.719ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4291 gateway = fd00:1122:3344:101::1
7012025-01-30T20:12:32.747ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4305 gateway = fd00:1122:3344:101::1
7022025-01-30T20:12:32.747ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4370
7032025-01-30T20:12:32.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 529.555935ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7042025-01-30T20:12:32.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 387.480085ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7052025-01-30T20:12:32.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 1.117592011s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7062025-01-30T20:12:33.000ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4436
7072025-01-30T20:12:33.000ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4463
7082025-01-30T20:12:33.048ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4476
7092025-01-30T20:12:33.048ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4322
7102025-01-30T20:12:33.102ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4364
7112025-01-30T20:12:33.102ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4443 rack_subnet = fd00:1122:3344::
7122025-01-30T20:12:33.125ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4454
7132025-01-30T20:12:33.125ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4496
7142025-01-30T20:12:33.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 1.148187528s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7152025-01-30T20:12:33.198ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4528
7162025-01-30T20:12:33.198ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4534
7172025-01-30T20:12:33.289ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4575
7182025-01-30T20:12:33.289ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7192025-01-30T20:12:33.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 1.138274553s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7202025-01-30T20:12:33.323ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/nexus.rs:530 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
7212025-01-30T20:12:33.323ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7222025-01-30T20:12:33.365ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7232025-01-30T20:12:33.365ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7242025-01-30T20:12:33.366ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7252025-01-30T20:12:33.366ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7262025-01-30T20:12:33.406ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
7272025-01-30T20:12:33.457ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7282025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7292025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7302025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7312025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7322025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7332025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7342025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7352025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7362025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7372025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7382025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7392025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7402025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7412025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7422025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7432025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7442025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7452025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7462025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7472025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7482025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7492025-01-30T20:12:33.457ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7502025-01-30T20:12:33.723ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
7512025-01-30T20:12:33.723ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
7522025-01-30T20:12:33.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 972.983392ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7532025-01-30T20:12:34.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 967.633403ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7542025-01-30T20:12:34.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 1.200651903s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7552025-01-30T20:12:34.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 1.338868955s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7562025-01-30T20:12:35.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 1.118580891s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7572025-01-30T20:12:35.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 627.068382ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7582025-01-30T20:12:36.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 913.775672ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7592025-01-30T20:12:36.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 569.94588ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7602025-01-30T20:12:36.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 599.046547ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7612025-01-30T20:12:36.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b") failed: Property not found. retry in 1.231216218s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7622025-01-30T20:12:37.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81") failed: Property not found. retry in 614.682529ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7632025-01-30T20:12:37.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34") failed: Property not found. retry in 895.186398ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7642025-01-30T20:12:38.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_3e630c35-9e6f-4219-8e95-98b889a36f81
7652025-01-30T20:12:38.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_912f7b3b-f72d-4191-9a19-27e9c0d3675b
7662025-01-30T20:12:38.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_internal_dns_0d657c89-e0f4-4d06-8add-9d38e7aaaf34
7672025-01-30T20:12:38.137ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-01-30T20:12:38.138ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692025-01-30T20:12:38.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8680309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dbf280cf-8554-427f-9dd5-1f772e8d2a09 response_code = 204 uri = /omicron-zones
7702025-01-30T20:12:38.140ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712025-01-30T20:12:38.248ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 88.002065ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7722025-01-30T20:12:38.325ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a) file = sled-agent/src/nexus.rs:530 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
7732025-01-30T20:12:38.354ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-30T20:12:38.402ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-01-30T20:12:38.452ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762025-01-30T20:12:38.452ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772025-01-30T20:12:38.483ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782025-01-30T20:12:38.484ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792025-01-30T20:12:38.484ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802025-01-30T20:12:38.513ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 3e630c35-9e6f-4219-8e95-98b889a36f81 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d657c89-e0f4-4d06-8add-9d38e7aaaf34 (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 912f7b3b-f72d-4191-9a19-27e9c0d3675b (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d9e1f432-27b1-463b-9e91-3df82f0fe7ab, kind: Service { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 }, name: Name("ntp-eb918cd8-d014-41d0-8ecc-c254960e16a0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812025-01-30T20:12:38.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55880
7822025-01-30T20:12:38.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-30T20:12:38.513ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-30T20:12:38.524ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-30T20:12:38.524ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-30T20:12:38.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-30T20:12:38.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-30T20:12:38.542ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892025-01-30T20:12:38.542ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
7902025-01-30T20:12:38.543ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
7912025-01-30T20:12:38.543ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-30T20:12:38.554ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932025-01-30T20:12:38.586ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942025-01-30T20:12:38.586ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952025-01-30T20:12:38.586ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962025-01-30T20:12:38.616ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 245, 156]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972025-01-30T20:12:38.616ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = boundary_ntp
7982025-01-30T20:12:38.616ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7992025-01-30T20:12:38.616ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8002025-01-30T20:12:38.617ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8012025-01-30T20:12:38.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022025-01-30T20:12:38.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0 file = illumos-utils/src/zone.rs:325
8032025-01-30T20:12:38.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0 file = illumos-utils/src/zone.rs:363
8042025-01-30T20:12:39.301ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052025-01-30T20:12:39.301ZINFOSledAgent (ServiceManager): Booting oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8062025-01-30T20:12:39.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 34.636763ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8072025-01-30T20:12:39.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 119.935681ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8082025-01-30T20:12:39.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 247.840813ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8092025-01-30T20:12:39.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 233.910844ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8102025-01-30T20:12:40.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 1.022061877s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8112025-01-30T20:12:41.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 1.105895854s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8122025-01-30T20:12:42.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8132025-01-30T20:12:42.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8142025-01-30T20:12:42.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 1.474483388s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8152025-01-30T20:12:43.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8162025-01-30T20:12:43.725ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8172025-01-30T20:12:43.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0") failed: Property not found. retry in 783.430934ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8182025-01-30T20:12:44.574ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0
8192025-01-30T20:12:44.574ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-01-30T20:12:44.574ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212025-01-30T20:12:44.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6061974 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55880 req_id = 6a294483-24b8-4f77-ac52-1c2e6e37675e response_code = 204 uri = /omicron-zones
8222025-01-30T20:12:44.578ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232025-01-30T20:12:44.608ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242025-01-30T20:12:44.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44595
8252025-01-30T20:12:44.617ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8262025-01-30T20:12:44.617ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8497 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44595 req_id = 5eab0431-acf3-44bf-b756-4836c08759a9 response_code = 500 uri = /timesync
8272025-01-30T20:12:44.620ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282025-01-30T20:12:44.784ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-01-30T20:12:44.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51165
8302025-01-30T20:12:47.692ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8312025-01-30T20:12:48.136ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8322025-01-30T20:12:48.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8332025-01-30T20:12:48.793ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8342025-01-30T20:12:48.793ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51165 req_id = 92a2e703-3228-4d4a-bbea-4502a09323c6 response_code = 500 uri = /timesync
8352025-01-30T20:12:48.796ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-30T20:12:48.958ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-01-30T20:12:48.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36777
8382025-01-30T20:12:48.967ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8392025-01-30T20:12:48.967ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36777 req_id = 44332f55-44d5-4129-8095-c4cc46238cdd response_code = 500 uri = /timesync
8402025-01-30T20:12:48.970ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-01-30T20:12:49.148ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-01-30T20:12:49.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59577
8432025-01-30T20:12:53.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8442025-01-30T20:12:53.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8452025-01-30T20:12:54.184ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_eb918cd8-d014-41d0-8ecc-c254960e16a0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3889
8462025-01-30T20:12:54.184ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008787 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59577 req_id = 34cda37c-9958-4b50-beb5-0a278f544970 response_code = 500 uri = /timesync
8472025-01-30T20:12:54.186ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-30T20:12:54.397ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-30T20:12:54.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64286
8502025-01-30T20:12:54.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8888 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64286 req_id = c23a6b0c-4079-489d-a31e-6db030369355 response_code = 200 uri = /timesync
8512025-01-30T20:12:54.408ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.489462793 } file = sled-agent/src/rack_setup/service.rs:743
8522025-01-30T20:12:54.408ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-30T20:12:54.742ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-30T20:12:54.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50780
8552025-01-30T20:12:54.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8909 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50780 req_id = 1d72e4aa-796b-42a2-a7e4-80b938349f39 response_code = 200 uri = /timesync
8562025-01-30T20:12:54.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8572025-01-30T20:12:54.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8582025-01-30T20:12:54.754ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.488526106 } file = sled-agent/src/rack_setup/service.rs:743
8592025-01-30T20:12:54.754ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602025-01-30T20:12:54.941ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-01-30T20:12:54.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59243
8622025-01-30T20:12:54.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7395 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59243 req_id = 85a5e44c-6962-4609-a2b1-4b3d46f5568f response_code = 200 uri = /timesync
8632025-01-30T20:12:54.952ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.487989753 } file = sled-agent/src/rack_setup/service.rs:743
8642025-01-30T20:12:54.952ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652025-01-30T20:12:55.335ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662025-01-30T20:12:55.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43804
8672025-01-30T20:12:55.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43804 req_id = 10b2e3c3-c7da-4c04-a83b-c4abe0a91f3f response_code = 200 uri = /timesync
8682025-01-30T20:12:55.346ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.4543145 } file = sled-agent/src/rack_setup/service.rs:743
8692025-01-30T20:12:55.346ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702025-01-30T20:12:55.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8712025-01-30T20:12:55.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8722025-01-30T20:12:55.635ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8732025-01-30T20:12:55.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46550
8742025-01-30T20:12:55.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46550 req_id = 7d0b413c-7ccb-4c0b-9212-ac36c4fc0bc8 response_code = 200 uri = /timesync
8752025-01-30T20:12:55.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.453500092 } file = sled-agent/src/rack_setup/service.rs:743
8762025-01-30T20:12:55.646ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8772025-01-30T20:12:56.165ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782025-01-30T20:12:56.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58533
8792025-01-30T20:12:56.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58533 req_id = ac44f2d4-cac4-4757-8679-8837d41af4ed response_code = 200 uri = /timesync
8802025-01-30T20:12:56.175ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.447912186 } file = sled-agent/src/rack_setup/service.rs:743
8812025-01-30T20:12:56.175ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822025-01-30T20:12:56.775ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832025-01-30T20:12:56.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57924
8842025-01-30T20:12:56.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57924 req_id = 06c1891e-bf03-40ec-bcea-2ca99262b63f response_code = 200 uri = /timesync
8852025-01-30T20:12:56.786ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.446254194 } file = sled-agent/src/rack_setup/service.rs:743
8862025-01-30T20:12:56.786ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872025-01-30T20:12:57.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-01-30T20:12:57.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33362
8892025-01-30T20:12:57.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33362 req_id = d0aadfe1-a27e-4ece-b311-9b8b5e9b296b response_code = 200 uri = /timesync
8902025-01-30T20:12:57.316ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1160825616, ip_addr: 69.48.203.16, stratum: 3, ref_time: 1738267976.5499418, correction: -0.443758309 } file = sled-agent/src/rack_setup/service.rs:743
8912025-01-30T20:12:57.316ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-01-30T20:12:57.737ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932025-01-30T20:12:57.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63185
8942025-01-30T20:12:57.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63185 req_id = 957fad85-a143-4e91-b8d9-38794a712926 response_code = 200 uri = /timesync
8952025-01-30T20:12:57.749ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738267975.6334186, correction: -0.442586631 } file = sled-agent/src/rack_setup/service.rs:743
8962025-01-30T20:12:57.749ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972025-01-30T20:12:58.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
8982025-01-30T20:12:58.820ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992025-01-30T20:12:58.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46931
9002025-01-30T20:12:58.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7492 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46931 req_id = 222db7ec-f6a1-4ad7-a585-72e1a4f85c3b response_code = 200 uri = /timesync
9012025-01-30T20:12:58.831ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1160825616, ip_addr: 69.48.203.16, stratum: 3, ref_time: 1738267977.008009, correction: -0.435718626 } file = sled-agent/src/rack_setup/service.rs:743
9022025-01-30T20:12:58.831ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032025-01-30T20:12:59.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9042025-01-30T20:12:59.155ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9052025-01-30T20:12:59.982ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062025-01-30T20:12:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43090
9072025-01-30T20:12:59.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43090 req_id = c9a947b1-17ba-4638-a010-59e4f08cd20b response_code = 200 uri = /timesync
9082025-01-30T20:12:59.995ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1160825616, ip_addr: 69.48.203.16, stratum: 3, ref_time: 1738267978.163, correction: -0.432088703 } file = sled-agent/src/rack_setup/service.rs:743
9092025-01-30T20:12:59.995ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102025-01-30T20:13:00.749ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112025-01-30T20:13:00.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61470
9122025-01-30T20:13:00.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61470 req_id = 1e95db45-2ada-4277-bcb8-146e8a606058 response_code = 200 uri = /timesync
9132025-01-30T20:13:00.760ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1160825616, ip_addr: 69.48.203.16, stratum: 3, ref_time: 1738267979.0275216, correction: -0.4297795 } file = sled-agent/src/rack_setup/service.rs:743
9142025-01-30T20:13:00.760ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152025-01-30T20:13:02.268ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162025-01-30T20:13:02.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37201
9172025-01-30T20:13:02.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37201 req_id = 7021ccd6-3776-49ac-a195-0c55677573ba response_code = 200 uri = /timesync
9182025-01-30T20:13:02.280ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1160825616, ip_addr: 69.48.203.16, stratum: 3, ref_time: 1738267981.3836763, correction: -0.425458789 } file = sled-agent/src/rack_setup/service.rs:743
9192025-01-30T20:13:02.280ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-01-30T20:13:03.285ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9212025-01-30T20:13:03.286ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9222025-01-30T20:13:03.587ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9232025-01-30T20:13:03.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52742
9242025-01-30T20:13:03.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52742 req_id = a2730b7a-25fd-4d51-b597-3707590dfd31 response_code = 200 uri = /timesync
9252025-01-30T20:13:03.599ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267982.8661115, correction: -0.42176199 } file = sled-agent/src/rack_setup/service.rs:743
9262025-01-30T20:13:03.599ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9272025-01-30T20:13:04.032ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63150
9282025-01-30T20:13:04.032ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63150 req_id = b0fde009-52fd-4700-9035-cdb0693f7827 response_code = 200 uri = /baseboard
9292025-01-30T20:13:04.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9302025-01-30T20:13:04.728ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9312025-01-30T20:13:05.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9322025-01-30T20:13:05.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9332025-01-30T20:13:05.790ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9342025-01-30T20:13:05.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35866
9352025-01-30T20:13:05.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35866 req_id = c515ae8a-db73-41eb-8fdd-fc33521fe572 response_code = 200 uri = /timesync
9362025-01-30T20:13:05.802ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267984.9130254, correction: -0.415889591 } file = sled-agent/src/rack_setup/service.rs:743
9372025-01-30T20:13:05.802ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9382025-01-30T20:13:07.751ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 335.791814ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9392025-01-30T20:13:07.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402025-01-30T20:13:07.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40695
9412025-01-30T20:13:07.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9438 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40695 req_id = fef71a1c-d1f5-47dc-8b3d-e15de678dbba response_code = 200 uri = /timesync
9422025-01-30T20:13:07.829ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267986.407974, correction: -0.41051659 } file = sled-agent/src/rack_setup/service.rs:743
9432025-01-30T20:13:07.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442025-01-30T20:13:08.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9452025-01-30T20:13:09.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9462025-01-30T20:13:09.129ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9472025-01-30T20:13:12.499ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9482025-01-30T20:13:12.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62044
9492025-01-30T20:13:12.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62044 req_id = 4f2eb163-c5fc-4b26-8de3-e21292b40c3d response_code = 200 uri = /timesync
9502025-01-30T20:13:12.510ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267990.2419667, correction: -0.397840768 } file = sled-agent/src/rack_setup/service.rs:743
9512025-01-30T20:13:12.510ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9522025-01-30T20:13:13.261ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9532025-01-30T20:13:13.261ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9542025-01-30T20:13:14.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9552025-01-30T20:13:14.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9562025-01-30T20:13:15.551ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9572025-01-30T20:13:15.551ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9582025-01-30T20:13:16.203ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9592025-01-30T20:13:16.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59498
9602025-01-30T20:13:16.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59498 req_id = 114e2023-35c1-4e68-bf8a-87f3d67ecfab response_code = 200 uri = /timesync
9612025-01-30T20:13:16.214ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267994.8652763, correction: -0.387730777 } file = sled-agent/src/rack_setup/service.rs:743
9622025-01-30T20:13:16.214ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9632025-01-30T20:13:18.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9642025-01-30T20:13:18.914ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9652025-01-30T20:13:18.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46918
9662025-01-30T20:13:18.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46918 req_id = 07f7372e-b738-4829-8692-436f0755df81 response_code = 200 uri = /timesync
9672025-01-30T20:13:18.925ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738267997.2711525, correction: -0.380387843 } file = sled-agent/src/rack_setup/service.rs:743
9682025-01-30T20:13:18.925ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9692025-01-30T20:13:19.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9702025-01-30T20:13:19.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9712025-01-30T20:13:22.492ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9722025-01-30T20:13:22.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60586
9732025-01-30T20:13:22.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7968 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60586 req_id = a8bbca91-68c6-4935-b869-d6eef17b1222 response_code = 200 uri = /timesync
9742025-01-30T20:13:22.503ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268001.2696908, correction: -0.370640218 } file = sled-agent/src/rack_setup/service.rs:743
9752025-01-30T20:13:22.503ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9762025-01-30T20:13:23.082ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 650.309888ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9772025-01-30T20:13:23.235ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14061675621099419563 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9782025-01-30T20:13:23.235ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12358499008182045459 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9792025-01-30T20:13:24.678ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9802025-01-30T20:13:24.678ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9812025-01-30T20:13:25.526ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9822025-01-30T20:13:25.526ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9832025-01-30T20:13:27.946ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9842025-01-30T20:13:27.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59131
9852025-01-30T20:13:27.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59131 req_id = 81009de9-523d-4d53-914e-a118582dac52 response_code = 200 uri = /timesync
9862025-01-30T20:13:27.958ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268006.487476, correction: -0.355780303 } file = sled-agent/src/rack_setup/service.rs:743
9872025-01-30T20:13:27.958ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9882025-01-30T20:13:28.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9892025-01-30T20:13:29.077ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9902025-01-30T20:13:29.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9912025-01-30T20:13:33.983ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48515
9922025-01-30T20:13:33.984ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48515 req_id = d2aef92c-f793-4309-ba47-05e7513a5071 response_code = 200 uri = /baseboard
9932025-01-30T20:13:34.653ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9942025-01-30T20:13:34.653ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9952025-01-30T20:13:35.501ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9962025-01-30T20:13:35.501ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
9972025-01-30T20:13:37.709ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9982025-01-30T20:13:37.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47502
9992025-01-30T20:13:37.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47502 req_id = 913cc1d9-d39b-4363-bd23-cec9859a9d4c response_code = 200 uri = /timesync
10002025-01-30T20:13:37.721ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268015.3512893, correction: -0.329308689 } file = sled-agent/src/rack_setup/service.rs:743
10012025-01-30T20:13:37.721ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10022025-01-30T20:13:38.609ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8925784431375847611 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10032025-01-30T20:13:38.726ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.077506078s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10042025-01-30T20:13:39.052ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17287461018825948079 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10052025-01-30T20:13:39.052ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13799194237880532484 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10062025-01-30T20:13:44.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10072025-01-30T20:13:44.629ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10082025-01-30T20:13:45.475ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6871139313750401244 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10092025-01-30T20:13:45.476ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1561352165972654856 reason = Duration(60s) sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10102025-01-30T20:13:51.695ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10112025-01-30T20:13:51.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45090
10122025-01-30T20:13:51.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9079 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45090 req_id = 62654341-e50a-4dcf-b04d-f9d87b455ecd response_code = 200 uri = /timesync
10132025-01-30T20:13:51.707ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268027.4537697, correction: -0.291331053 } file = sled-agent/src/rack_setup/service.rs:743
10142025-01-30T20:13:51.707ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10152025-01-30T20:13:54.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10162025-01-30T20:13:54.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10172025-01-30T20:13:54.795ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.620960964s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10182025-01-30T20:13:57.550ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10192025-01-30T20:13:57.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56198
10202025-01-30T20:13:57.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10442 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56198 req_id = d42fae51-7660-4f6b-af6b-151fa5f84add response_code = 200 uri = /timesync
10212025-01-30T20:13:57.565ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268035.044972, correction: -0.275442392 } file = sled-agent/src/rack_setup/service.rs:743
10222025-01-30T20:13:57.565ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10232025-01-30T20:14:03.937ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34244
10242025-01-30T20:14:03.937ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34244 req_id = e7afa67c-62e0-4554-8dfa-d8e11029169a response_code = 200 uri = /baseboard
10252025-01-30T20:14:04.579ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10262025-01-30T20:14:04.579ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10272025-01-30T20:14:12.403ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.699958377s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10282025-01-30T20:14:14.554ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10292025-01-30T20:14:14.554ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10302025-01-30T20:14:14.752ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10312025-01-30T20:14:14.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37532
10322025-01-30T20:14:14.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37532 req_id = 44420255-881d-4e8d-ad73-5689cf48a4c5 response_code = 200 uri = /timesync
10332025-01-30T20:14:14.764ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268051.9325404, correction: -0.228758797 } file = sled-agent/src/rack_setup/service.rs:743
10342025-01-30T20:14:14.764ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10352025-01-30T20:14:24.528ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10362025-01-30T20:14:24.528ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10372025-01-30T20:14:26.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10382025-01-30T20:14:26.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56122
10392025-01-30T20:14:26.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56122 req_id = 1a76240b-a704-4b24-93dd-d7a345b07f88 response_code = 200 uri = /timesync
10402025-01-30T20:14:26.180ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268059.876855, correction: -0.197764069 } file = sled-agent/src/rack_setup/service.rs:743
10412025-01-30T20:14:26.180ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10422025-01-30T20:14:32.087ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.819833114s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10432025-01-30T20:14:33.890ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34037
10442025-01-30T20:14:33.890ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34037 req_id = d3f364cb-5884-4b58-835f-8cb4019af0b6 response_code = 200 uri = /baseboard
10452025-01-30T20:14:34.504ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10462025-01-30T20:14:34.504ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10472025-01-30T20:14:36.771ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10482025-01-30T20:14:36.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59183
10492025-01-30T20:14:36.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59183 req_id = fa6de19e-4920-4ac3-8b54-8a5ca0099597 response_code = 200 uri = /timesync
10502025-01-30T20:14:36.784ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3326554699, ip_addr: 198.71.50.75, stratum: 3, ref_time: 1738268075.7369142, correction: -0.168975279 } file = sled-agent/src/rack_setup/service.rs:743
10512025-01-30T20:14:36.784ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10522025-01-30T20:14:44.478ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10532025-01-30T20:14:44.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10542025-01-30T20:14:54.454ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10552025-01-30T20:14:54.454ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10562025-01-30T20:14:55.876ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.105214445s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10572025-01-30T20:15:00.321ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10582025-01-30T20:15:00.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42473
10592025-01-30T20:15:00.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42473 req_id = 6a25a3e5-7ace-4ab8-a9e0-11961009dd32 response_code = 200 uri = /timesync
10602025-01-30T20:15:00.332ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1209934681, ip_addr: 72.30.35.89, stratum: 3, ref_time: 1738268099.7171907, correction: -0.101468466 } file = sled-agent/src/rack_setup/service.rs:743
10612025-01-30T20:15:00.332ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10622025-01-30T20:15:03.840ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53347
10632025-01-30T20:15:03.840ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53347 req_id = 60e71799-94db-4476-8aa9-0562eb047891 response_code = 200 uri = /baseboard
10642025-01-30T20:15:04.428ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10652025-01-30T20:15:04.428ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10662025-01-30T20:15:14.402ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10672025-01-30T20:15:14.402ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10682025-01-30T20:15:17.357ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10692025-01-30T20:15:17.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53096
10702025-01-30T20:15:17.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8634 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53096 req_id = a264ab14-51d9-4c15-9c21-dd0e951d8480 response_code = 200 uri = /timesync
10712025-01-30T20:15:17.367ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1209934681, ip_addr: 72.30.35.89, stratum: 3, ref_time: 1738268115.875275, correction: -0.055185884 } file = sled-agent/src/rack_setup/service.rs:743
10722025-01-30T20:15:17.368ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10732025-01-30T20:15:18.954ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 23.042573581s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10742025-01-30T20:15:24.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10752025-01-30T20:15:24.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10762025-01-30T20:15:33.792ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53532
10772025-01-30T20:15:33.792ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53532 req_id = cfbd62e3-203f-4e96-8436-07e1412a8648 response_code = 200 uri = /baseboard
10782025-01-30T20:15:34.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10792025-01-30T20:15:34.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10802025-01-30T20:15:44.344ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10812025-01-30T20:15:44.345ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10822025-01-30T20:15:54.346ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12051600431812284226 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10832025-01-30T20:15:54.346ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9329637499586047183 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10842025-01-30T20:15:56.979ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 85.525172814s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10852025-01-30T20:16:02.624ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10862025-01-30T20:16:02.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53640
10872025-01-30T20:16:02.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20578 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53640 req_id = 92c63c7e-dfaf-4406-8caf-cdb293c55836 response_code = 200 uri = /timesync
10882025-01-30T20:16:02.645ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:39.052434342Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13799194237880532484 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10892025-01-30T20:16:02.646ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:38.609930028Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8925784431375847611 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10902025-01-30T20:16:02.647ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:23.235294561Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14061675621099419563 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10912025-01-30T20:16:02.647ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:45.476224523Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1561352165972654856 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10922025-01-30T20:16:02.647ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:45.475969761Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6871139313750401244 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10932025-01-30T20:16:02.648ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:23.235776905Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12358499008182045459 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10942025-01-30T20:16:02.648ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-30T20:13:39.052230577Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17287461018825948079 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
10952025-01-30T20:16:02.650ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1209934681, ip_addr: 72.30.35.89, stratum: 3, ref_time: 1738268156.445607, correction: 0.000464046 } file = sled-agent/src/rack_setup/service.rs:743
10962025-01-30T20:16:02.650ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
10972025-01-30T20:16:02.681ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 3e630c35-9e6f-4219-8e95-98b889a36f81 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d657c89-e0f4-4d06-8add-9d38e7aaaf34 (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 912f7b3b-f72d-4191-9a19-27e9c0d3675b (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d9e1f432-27b1-463b-9e91-3df82f0fe7ab, kind: Service { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 }, name: Name("ntp-eb918cd8-d014-41d0-8ecc-c254960e16a0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9cfcead9-c07b-4a3f-80b0-fc022bb168cf (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0abd2045-28a5-40c9-8b95-75ed8612d34a (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40d19aa5-a20b-4580-a391-111b94e60bbc (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 32a42603-33aa-4b0e-9fac-e3cb01f03c2d (service), filesystem_pool: Some(ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External } } } }, OmicronZoneConfig { id: 659b342a-7b7c-4019-9dac-4155dcd9cd8c (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10982025-01-30T20:16:02.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33621
10992025-01-30T20:16:02.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-30T20:16:02.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11012025-01-30T20:16:02.693ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-30T20:16:02.693ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11032025-01-30T20:16:02.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-30T20:16:02.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11052025-01-30T20:16:02.711ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-30T20:16:02.711ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11072025-01-30T20:16:02.720ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-30T20:16:02.720ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11092025-01-30T20:16:02.730ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-30T20:16:02.730ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11112025-01-30T20:16:02.739ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-30T20:16:02.739ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, responder: ... }
11132025-01-30T20:16:02.749ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-30T20:16:02.749ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, responder: ... }
11152025-01-30T20:16:02.758ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11162025-01-30T20:16:02.758ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
11172025-01-30T20:16:02.759ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
11182025-01-30T20:16:02.759ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11192025-01-30T20:16:02.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11202025-01-30T20:16:02.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212025-01-30T20:16:02.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11222025-01-30T20:16:02.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232025-01-30T20:16:02.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11242025-01-30T20:16:02.928ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf file = illumos-utils/src/zone.rs:325
11252025-01-30T20:16:02.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c file = illumos-utils/src/zone.rs:325
11262025-01-30T20:16:02.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a file = illumos-utils/src/zone.rs:325
11272025-01-30T20:16:02.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc file = illumos-utils/src/zone.rs:325
11282025-01-30T20:16:02.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d file = illumos-utils/src/zone.rs:325
11292025-01-30T20:16:02.949ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf file = illumos-utils/src/zone.rs:363
11302025-01-30T20:16:02.954ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c file = illumos-utils/src/zone.rs:363
11312025-01-30T20:16:02.959ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a file = illumos-utils/src/zone.rs:363
11322025-01-30T20:16:02.963ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc file = illumos-utils/src/zone.rs:363
11332025-01-30T20:16:02.968ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d file = illumos-utils/src/zone.rs:363
11342025-01-30T20:16:03.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49640
11352025-01-30T20:16:03.818ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49640 req_id = 58df16cf-6ec4-4b29-a11b-3110dfb34c37 response_code = 200 uri = /baseboard
11362025-01-30T20:16:06.639ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9cfcead9-c07b-4a3f-80b0-fc022bb168cf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11372025-01-30T20:16:06.639ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11382025-01-30T20:16:06.692ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='32a42603-33aa-4b0e-9fac-e3cb01f03c2d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11392025-01-30T20:16:06.693ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11402025-01-30T20:16:06.698ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='40d19aa5-a20b-4580-a391-111b94e60bbc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412025-01-30T20:16:06.698ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11422025-01-30T20:16:06.735ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0abd2045-28a5-40c9-8b95-75ed8612d34a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11432025-01-30T20:16:06.735ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11442025-01-30T20:16:06.741ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='659b342a-7b7c-4019-9dac-4155dcd9cd8c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11452025-01-30T20:16:06.742ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11462025-01-30T20:16:06.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 36.709694ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11472025-01-30T20:16:06.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 42.300057ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11482025-01-30T20:16:06.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 73.865216ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11492025-01-30T20:16:06.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 119.571409ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11502025-01-30T20:16:06.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 66.834664ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11512025-01-30T20:16:06.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 31.69373ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11522025-01-30T20:16:06.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 61.305798ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11532025-01-30T20:16:07.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 287.135726ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11542025-01-30T20:16:07.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 55.467197ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11552025-01-30T20:16:07.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 127.48219ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11562025-01-30T20:16:07.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 129.366829ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11572025-01-30T20:16:07.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 105.550395ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11582025-01-30T20:16:07.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 265.875282ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11592025-01-30T20:16:07.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 136.221348ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11602025-01-30T20:16:07.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 187.973427ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11612025-01-30T20:16:07.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 405.212916ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11622025-01-30T20:16:07.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 277.224194ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11632025-01-30T20:16:07.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 351.997183ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11642025-01-30T20:16:07.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 567.218976ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11652025-01-30T20:16:07.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 298.190977ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11662025-01-30T20:16:08.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 603.907163ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11672025-01-30T20:16:08.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 746.517511ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11682025-01-30T20:16:08.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 820.38712ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11692025-01-30T20:16:08.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 643.073561ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11702025-01-30T20:16:08.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 861.652759ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11712025-01-30T20:16:08.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 650.193721ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11722025-01-30T20:16:08.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 998.960754ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11732025-01-30T20:16:08.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 679.707973ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11742025-01-30T20:16:09.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 662.89449ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11752025-01-30T20:16:09.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 852.169761ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11762025-01-30T20:16:09.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 1.10212696s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11772025-01-30T20:16:09.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 557.023057ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11782025-01-30T20:16:09.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 901.261204ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11792025-01-30T20:16:09.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 882.40975ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11802025-01-30T20:16:10.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 552.173434ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11812025-01-30T20:16:10.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.225244105s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11822025-01-30T20:16:10.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 1.24180872s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11832025-01-30T20:16:10.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 1.392975786s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11842025-01-30T20:16:10.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 629.701925ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11852025-01-30T20:16:10.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.329865176s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11862025-01-30T20:16:11.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 806.712854ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11872025-01-30T20:16:11.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.112221815s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11882025-01-30T20:16:11.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 810.407787ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11892025-01-30T20:16:12.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 560.932619ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11902025-01-30T20:16:12.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 752.350061ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11912025-01-30T20:16:12.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 981.660165ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11922025-01-30T20:16:12.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.402811623s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11932025-01-30T20:16:12.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf") failed: Property not found. retry in 899.736331ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
11942025-01-30T20:16:12.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc") failed: Property not found. retry in 685.033842ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
11952025-01-30T20:16:12.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 897.77501ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11962025-01-30T20:16:13.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 832.586146ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
11972025-01-30T20:16:13.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.388856587s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
11982025-01-30T20:16:14.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 788.949553ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
11992025-01-30T20:16:14.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 719.480502ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12002025-01-30T20:16:14.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 765.290749ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12012025-01-30T20:16:14.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 918.54298ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12022025-01-30T20:16:15.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 550.259544ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12032025-01-30T20:16:15.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 1.253470818s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12042025-01-30T20:16:15.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 963.860246ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12052025-01-30T20:16:15.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.322397094s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12062025-01-30T20:16:16.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.173903234s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12072025-01-30T20:16:16.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 957.606846ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12082025-01-30T20:16:17.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.074079534s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12092025-01-30T20:16:17.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 1.486171675s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12102025-01-30T20:16:17.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.261960322s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12112025-01-30T20:16:18.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 662.780307ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12122025-01-30T20:16:18.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.231105872s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12132025-01-30T20:16:19.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.376811777s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12142025-01-30T20:16:19.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 632.273261ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12152025-01-30T20:16:19.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 1.136723932s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12162025-01-30T20:16:20.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 798.954127ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12172025-01-30T20:16:20.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.372639533s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12182025-01-30T20:16:20.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.415785266s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12192025-01-30T20:16:21.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 999.349909ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12202025-01-30T20:16:21.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 602.10421ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12212025-01-30T20:16:22.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d") failed: Property not found. retry in 1.450943378s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12222025-01-30T20:16:22.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 619.90669ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12232025-01-30T20:16:22.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a") failed: Property not found. retry in 1.374145167s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12242025-01-30T20:16:22.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c") failed: Property not found. retry in 1.41548989s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12252025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_9cfcead9-c07b-4a3f-80b0-fc022bb168cf
12262025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_659b342a-7b7c-4019-9dac-4155dcd9cd8c
12272025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_0abd2045-28a5-40c9-8b95-75ed8612d34a
12282025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_40d19aa5-a20b-4580-a391-111b94e60bbc
12292025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_cockroachdb_32a42603-33aa-4b0e-9fac-e3cb01f03c2d
12302025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12312025-01-30T20:16:24.412ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12322025-01-30T20:16:24.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21731361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33621 req_id = a85d602c-9fb3-4ada-b7e4-2b4fa001e059 response_code = 204 uri = /omicron-zones
12332025-01-30T20:16:24.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51883
12342025-01-30T20:16:24.481ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3732
12352025-01-30T20:16:34.511ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3750
12362025-01-30T20:16:44.842ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3773
12372025-01-30T20:16:44.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20393243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51883 req_id = 2511ac33-537c-47fa-aa84-cd95911126e1 response_code = 204 uri = /cockroachdb
12382025-01-30T20:16:44.844ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60419
12392025-01-30T20:16:44.845ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 556 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60419 req_id = d57fea3f-49b3-46d5-8e68-c402950ef10e response_code = 200 uri = /baseboard
12402025-01-30T20:16:44.885ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 3e630c35-9e6f-4219-8e95-98b889a36f81 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0d657c89-e0f4-4d06-8add-9d38e7aaaf34 (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 912f7b3b-f72d-4191-9a19-27e9c0d3675b (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d9e1f432-27b1-463b-9e91-3df82f0fe7ab, kind: Service { id: eb918cd8-d014-41d0-8ecc-c254960e16a0 }, name: Name("ntp-eb918cd8-d014-41d0-8ecc-c254960e16a0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 156])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9cfcead9-c07b-4a3f-80b0-fc022bb168cf (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0abd2045-28a5-40c9-8b95-75ed8612d34a (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40d19aa5-a20b-4580-a391-111b94e60bbc (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 32a42603-33aa-4b0e-9fac-e3cb01f03c2d (service), filesystem_pool: Some(ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External } } } }, OmicronZoneConfig { id: 659b342a-7b7c-4019-9dac-4155dcd9cd8c (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External } } } }, OmicronZoneConfig { id: db149fee-69cf-48fe-8393-2d952566bed4 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f (service), filesystem_pool: Some(ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 623434f7-1950-4ff8-a21d-872e401e4248 (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 94aca596-2d3a-41fa-b190-8ec8091a0396 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } } } }, OmicronZoneConfig { id: a3e5a327-9dfd-478d-97c5-b64c085e6d6f (service), filesystem_pool: Some(ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d72b58a3-5740-4826-8959-b97b4166d85a (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 536196d0-1d62-4b76-a1f0-048d89f91f28 (service), filesystem_pool: Some(ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: f8657d8f-a69b-4dfb-9355-447ac02b9343 (service), filesystem_pool: Some(ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 64e08b7b-0310-4251-a20b-2963dbea9fde (service), filesystem_pool: Some(ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66c3541c-6e49-42b2-96dc-595f0f10d5ed (service), filesystem_pool: Some(ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 90f92d6a-77b5-41de-a00e-410469bf76aa (service), filesystem_pool: Some(ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External } } } }, OmicronZoneConfig { id: bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2 (service), filesystem_pool: Some(ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External } } } }, OmicronZoneConfig { id: ce48895d-4e58-4427-9e4c-eba683b07291 (service), filesystem_pool: Some(ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External } } } }, OmicronZoneConfig { id: 623f9e2f-1569-44c6-9d6d-f26f14cc9d08 (service), filesystem_pool: Some(ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External } } } }, OmicronZoneConfig { id: 3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a (service), filesystem_pool: Some(ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e22325b-faaf-4d80-9bba-9add9bffff4d (service), filesystem_pool: Some(ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12412025-01-30T20:16:44.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43550
12422025-01-30T20:16:44.887ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12432025-01-30T20:16:44.888ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12442025-01-30T20:16:44.901ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12452025-01-30T20:16:44.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12462025-01-30T20:16:44.911ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12472025-01-30T20:16:44.911ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12482025-01-30T20:16:44.921ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12492025-01-30T20:16:44.921ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12502025-01-30T20:16:44.931ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12512025-01-30T20:16:44.931ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12522025-01-30T20:16:44.940ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12532025-01-30T20:16:44.940ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12542025-01-30T20:16:44.949ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12552025-01-30T20:16:44.949ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Cockroach }, responder: ... }
12562025-01-30T20:16:44.959ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12572025-01-30T20:16:44.960ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Cockroach }, responder: ... }
12582025-01-30T20:16:44.970ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12592025-01-30T20:16:44.970ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12602025-01-30T20:16:44.986ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12612025-01-30T20:16:44.986ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12622025-01-30T20:16:45.004ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12632025-01-30T20:16:45.004ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12642025-01-30T20:16:45.014ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12652025-01-30T20:16:45.014ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, kind: Crucible }, responder: ... }
12662025-01-30T20:16:45.025ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12672025-01-30T20:16:45.025ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, kind: Crucible }, responder: ... }
12682025-01-30T20:16:45.035ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12692025-01-30T20:16:45.035ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12702025-01-30T20:16:45.045ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12712025-01-30T20:16:45.045ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, kind: Crucible }, responder: ... }
12722025-01-30T20:16:45.054ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12732025-01-30T20:16:45.054ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, kind: Crucible }, responder: ... }
12742025-01-30T20:16:45.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12752025-01-30T20:16:45.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, kind: Crucible }, responder: ... }
12762025-01-30T20:16:45.073ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12772025-01-30T20:16:45.073ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, kind: Crucible }, responder: ... }
12782025-01-30T20:16:45.082ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12792025-01-30T20:16:45.082ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, kind: Crucible }, responder: ... }
12802025-01-30T20:16:45.092ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12812025-01-30T20:16:45.092ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, kind: Crucible }, responder: ... }
12822025-01-30T20:16:45.104ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12832025-01-30T20:16:45.104ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
12842025-01-30T20:16:45.105ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
12852025-01-30T20:16:45.105ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12862025-01-30T20:16:45.225ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12872025-01-30T20:16:45.226ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12882025-01-30T20:16:45.262ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12892025-01-30T20:16:45.262ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12902025-01-30T20:16:45.262ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12912025-01-30T20:16:45.262ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12922025-01-30T20:16:45.263ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12932025-01-30T20:16:45.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12942025-01-30T20:16:45.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12952025-01-30T20:16:45.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12962025-01-30T20:16:45.462ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12972025-01-30T20:16:45.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12982025-01-30T20:16:45.464ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12992025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13002025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13012025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13022025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13032025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13042025-01-30T20:16:45.515ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13052025-01-30T20:16:45.515ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28 file = illumos-utils/src/zone.rs:325
13062025-01-30T20:16:45.521ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396 file = illumos-utils/src/zone.rs:325
13072025-01-30T20:16:45.527ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a file = illumos-utils/src/zone.rs:325
13082025-01-30T20:16:45.532ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343 file = illumos-utils/src/zone.rs:325
13092025-01-30T20:16:45.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde file = illumos-utils/src/zone.rs:325
13102025-01-30T20:16:45.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed file = illumos-utils/src/zone.rs:325
13112025-01-30T20:16:45.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa file = illumos-utils/src/zone.rs:325
13122025-01-30T20:16:45.692ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28 file = illumos-utils/src/zone.rs:363
13132025-01-30T20:16:45.698ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396 file = illumos-utils/src/zone.rs:363
13142025-01-30T20:16:45.703ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a file = illumos-utils/src/zone.rs:363
13152025-01-30T20:16:45.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343 file = illumos-utils/src/zone.rs:363
13162025-01-30T20:16:45.712ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde file = illumos-utils/src/zone.rs:363
13172025-01-30T20:16:45.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed file = illumos-utils/src/zone.rs:363
13182025-01-30T20:16:45.721ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa file = illumos-utils/src/zone.rs:363
13192025-01-30T20:16:45.726ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a file = illumos-utils/src/zone.rs:325
13202025-01-30T20:16:45.733ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f file = illumos-utils/src/zone.rs:325
13212025-01-30T20:16:45.738ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291 file = illumos-utils/src/zone.rs:325
13222025-01-30T20:16:45.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08 file = illumos-utils/src/zone.rs:325
13232025-01-30T20:16:45.749ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2 file = illumos-utils/src/zone.rs:325
13242025-01-30T20:16:45.754ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248 file = illumos-utils/src/zone.rs:325
13252025-01-30T20:16:45.760ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d file = illumos-utils/src/zone.rs:325
13262025-01-30T20:16:45.826ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13272025-01-30T20:16:45.884ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13282025-01-30T20:16:45.884ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a file = illumos-utils/src/zone.rs:363
13292025-01-30T20:16:45.894ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f file = illumos-utils/src/zone.rs:363
13302025-01-30T20:16:45.902ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291 file = illumos-utils/src/zone.rs:363
13312025-01-30T20:16:45.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08 file = illumos-utils/src/zone.rs:363
13322025-01-30T20:16:45.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2 file = illumos-utils/src/zone.rs:363
13332025-01-30T20:16:45.922ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248 file = illumos-utils/src/zone.rs:363
13342025-01-30T20:16:45.929ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d file = illumos-utils/src/zone.rs:363
13352025-01-30T20:16:45.991ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13362025-01-30T20:16:45.996ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13372025-01-30T20:16:45.996ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13382025-01-30T20:16:46.088ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 173, 183]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13392025-01-30T20:16:46.089ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
13402025-01-30T20:16:46.092ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13412025-01-30T20:16:46.092ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13422025-01-30T20:16:46.162ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 205, 160]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13432025-01-30T20:16:46.162ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = external_dns
13442025-01-30T20:16:46.223ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13452025-01-30T20:16:46.285ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13462025-01-30T20:16:46.288ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13472025-01-30T20:16:46.288ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13482025-01-30T20:16:46.347ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 242, 12]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13492025-01-30T20:16:46.347ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
13502025-01-30T20:16:46.349ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13512025-01-30T20:16:46.349ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13522025-01-30T20:16:46.411ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 247, 65]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13532025-01-30T20:16:46.411ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = external_dns
13542025-01-30T20:16:46.411ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13552025-01-30T20:16:46.411ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13562025-01-30T20:16:46.462ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 241, 239]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13572025-01-30T20:16:46.462ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1242 zone_type = nexus
13582025-01-30T20:16:46.463ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13592025-01-30T20:16:46.463ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13602025-01-30T20:16:46.463ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13612025-01-30T20:16:46.463ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13622025-01-30T20:16:46.465ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13632025-01-30T20:16:46.465ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13642025-01-30T20:16:46.466ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13652025-01-30T20:16:46.466ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13662025-01-30T20:16:46.467ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13672025-01-30T20:16:46.469ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13682025-01-30T20:16:46.471ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13692025-01-30T20:16:46.474ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13702025-01-30T20:16:46.475ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13712025-01-30T20:16:46.475ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13722025-01-30T20:16:46.475ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13732025-01-30T20:16:46.477ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13742025-01-30T20:16:46.477ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13752025-01-30T20:16:46.477ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13762025-01-30T20:16:46.916ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13772025-01-30T20:16:46.924ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13782025-01-30T20:16:46.925ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf file = illumos-utils/src/zone.rs:325
13792025-01-30T20:16:46.952ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4 file = illumos-utils/src/zone.rs:325
13802025-01-30T20:16:46.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3 file = illumos-utils/src/zone.rs:325
13812025-01-30T20:16:46.989ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f file = illumos-utils/src/zone.rs:325
13822025-01-30T20:16:47.048ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf file = illumos-utils/src/zone.rs:363
13832025-01-30T20:16:47.069ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4 file = illumos-utils/src/zone.rs:363
13842025-01-30T20:16:47.094ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3 file = illumos-utils/src/zone.rs:363
13852025-01-30T20:16:47.107ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f file = illumos-utils/src/zone.rs:363
13862025-01-30T20:16:47.118ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f file = illumos-utils/src/zone.rs:325
13872025-01-30T20:16:47.166ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f file = illumos-utils/src/zone.rs:363
13882025-01-30T20:16:49.471ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892025-01-30T20:16:49.473ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13902025-01-30T20:16:49.473ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
13912025-01-30T20:16:49.491ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
13922025-01-30T20:16:49.532ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_267308a4-806f-4489-9002-d2fdc6345ade/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a6d68792-60c0-4478-811c-8342e7a0c3a3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13932025-01-30T20:16:49.536ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cf23c722-8321-4fb9-abd8-d00f95364be6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942025-01-30T20:16:49.540ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='230c9f6b-899b-4934-9306-7bd80f8b000b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13952025-01-30T20:16:49.541ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4471ea16-a24f-4b2e-b5b9-63b098d28e53'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962025-01-30T20:16:49.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4b0a741f-1a50-4435-86eb-840852315494'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13972025-01-30T20:16:49.544ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e04f8928-4530-4288-b470-e4b4780b8353/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='da20a252-f3db-4403-8c92-cc37a7e6ef7e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13982025-01-30T20:16:49.557ZINFOSledAgent (ServiceManager): Booting oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
13992025-01-30T20:16:49.561ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14002025-01-30T20:16:49.576ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14012025-01-30T20:16:49.589ZINFOSledAgent (ServiceManager): Booting oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14022025-01-30T20:16:49.606ZINFOSledAgent (ServiceManager): Booting oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14032025-01-30T20:16:49.620ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14042025-01-30T20:16:49.633ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='331667a0-09ab-46aa-9ece-def7ef527c89'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052025-01-30T20:16:49.633ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14062025-01-30T20:17:00.303ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='623434f7-1950-4ff8-a21d-872e401e4248'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14072025-01-30T20:17:00.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 28.600927ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14082025-01-30T20:17:00.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 68.483188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14092025-01-30T20:17:00.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 40.361069ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14102025-01-30T20:17:00.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 69.471845ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14112025-01-30T20:17:00.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 42.88574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14122025-01-30T20:17:00.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 61.59916ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14132025-01-30T20:17:00.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 47.435949ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14142025-01-30T20:17:00.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 59.122782ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14152025-01-30T20:17:00.381ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14162025-01-30T20:17:00.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 60.865013ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14172025-01-30T20:17:00.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 91.258547ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14182025-01-30T20:17:00.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 129.224817ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14192025-01-30T20:17:00.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 118.491481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14202025-01-30T20:17:00.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 148.852264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14212025-01-30T20:17:00.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 144.555445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14222025-01-30T20:17:00.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 78.833885ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14232025-01-30T20:17:00.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 117.856948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14242025-01-30T20:17:00.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 89.934144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14252025-01-30T20:17:00.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 96.081811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14262025-01-30T20:17:00.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 212.347801ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14272025-01-30T20:17:00.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 133.18369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14282025-01-30T20:17:00.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 184.861951ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14292025-01-30T20:17:00.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 180.763897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14302025-01-30T20:17:00.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 221.898928ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14312025-01-30T20:17:00.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 103.152082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14322025-01-30T20:17:00.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 141.450198ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14332025-01-30T20:17:00.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 266.868656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14342025-01-30T20:17:00.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 207.663606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14352025-01-30T20:17:00.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 74.051686ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14362025-01-30T20:17:00.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 203.34256ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14372025-01-30T20:17:00.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 563.140178ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14382025-01-30T20:17:00.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 94.508371ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14392025-01-30T20:17:00.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 563.335573ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14402025-01-30T20:17:00.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 552.048948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14412025-01-30T20:17:00.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 330.888932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14422025-01-30T20:17:00.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 426.659658ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14432025-01-30T20:17:00.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 585.711662ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14442025-01-30T20:17:00.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 295.519713ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14452025-01-30T20:17:00.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 361.255402ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14462025-01-30T20:17:00.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 515.485776ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14472025-01-30T20:17:00.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 921.819757ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14482025-01-30T20:17:00.936ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7414a064-4217-4398-b36a-c06130bcb569/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='552c0390-e110-4472-a17a-0e15a5488c47'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14492025-01-30T20:17:00.936ZINFOSledAgent (ServiceManager): Booting oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14502025-01-30T20:17:01.027ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14512025-01-30T20:17:01.028ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14522025-01-30T20:17:01.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 969.646594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14532025-01-30T20:17:01.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 564.104817ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14542025-01-30T20:17:01.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 44.326326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14552025-01-30T20:17:01.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 891.539746ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14562025-01-30T20:17:01.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 57.440329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14572025-01-30T20:17:01.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 652.442224ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14582025-01-30T20:17:01.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 486.603554ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14592025-01-30T20:17:01.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 809.851495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14602025-01-30T20:17:01.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.035121939s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14612025-01-30T20:17:01.351ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14622025-01-30T20:17:01.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 31.899143ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14632025-01-30T20:17:01.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 210.087896ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14642025-01-30T20:17:01.373ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14652025-01-30T20:17:01.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 106.527342ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14662025-01-30T20:17:01.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.1323959s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14672025-01-30T20:17:01.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 998.415214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14682025-01-30T20:17:01.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 140.331574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14692025-01-30T20:17:01.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 428.466588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14702025-01-30T20:17:01.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 340.933741ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14712025-01-30T20:17:01.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 410.749503ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14722025-01-30T20:17:01.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 57.22334ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14732025-01-30T20:17:01.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 638.574565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14742025-01-30T20:17:01.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.269455537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
14752025-01-30T20:17:01.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 67.234335ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14762025-01-30T20:17:01.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 125.615797ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14772025-01-30T20:17:01.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 829.257993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14782025-01-30T20:17:02.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 902.970045ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
14792025-01-30T20:17:02.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 413.205503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14802025-01-30T20:17:02.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 457.768648ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14812025-01-30T20:17:02.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 832.17593ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
14822025-01-30T20:17:02.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.139122935s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
14832025-01-30T20:17:02.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 666.692127ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14842025-01-30T20:17:02.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.242379998s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
14852025-01-30T20:17:02.224ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14862025-01-30T20:17:02.224ZINFOSledAgent (ServiceManager): Booting oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
14872025-01-30T20:17:02.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.349490499s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
14882025-01-30T20:17:02.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 29.442177ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
14892025-01-30T20:17:02.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 64.604651ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
14902025-01-30T20:17:02.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 789.417325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
14912025-01-30T20:17:02.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.097598108s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
14922025-01-30T20:17:02.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 162.643793ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
14932025-01-30T20:17:02.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.124242889s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
14942025-01-30T20:17:02.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.037971075s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
14952025-01-30T20:17:02.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.020060765s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
14962025-01-30T20:17:02.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 407.433972ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
14972025-01-30T20:17:02.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.047488643s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
14982025-01-30T20:17:02.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.362909101s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
14992025-01-30T20:17:02.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 842.147669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15002025-01-30T20:17:03.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 607.350184ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
15012025-01-30T20:17:03.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 597.692971ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15022025-01-30T20:17:03.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.184348994s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
15032025-01-30T20:17:03.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 870.157497ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
15042025-01-30T20:17:03.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 982.854495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15052025-01-30T20:17:03.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 567.060492ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
15062025-01-30T20:17:03.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 797.427944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
15072025-01-30T20:17:03.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 911.811835ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
15082025-01-30T20:17:03.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.385726403s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
15092025-01-30T20:17:03.633ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='76942755-42fe-4c13-87ef-1592072c68c5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15102025-01-30T20:17:03.633ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15112025-01-30T20:17:03.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 717.860521ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
15122025-01-30T20:17:03.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 894.335985ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
15132025-01-30T20:17:03.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 908.862862ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15142025-01-30T20:17:03.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 772.301506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
15152025-01-30T20:17:03.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 44.843593ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15162025-01-30T20:17:03.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.198305275s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15172025-01-30T20:17:03.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.022602448s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
15182025-01-30T20:17:03.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 138.612683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15192025-01-30T20:17:04.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 151.496114ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15202025-01-30T20:17:04.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 831.18152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
15212025-01-30T20:17:04.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.328668568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
15222025-01-30T20:17:04.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 348.36031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15232025-01-30T20:17:04.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 784.986729ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
15242025-01-30T20:17:04.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 761.397197ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
15252025-01-30T20:17:04.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 618.283447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15262025-01-30T20:17:04.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.310826051s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
15272025-01-30T20:17:04.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.019052766s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
15282025-01-30T20:17:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 968.572794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
15292025-01-30T20:17:04.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.438347547s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
15302025-01-30T20:17:04.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 736.586395ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15312025-01-30T20:17:04.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.19701309s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
15322025-01-30T20:17:04.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 778.276073ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15332025-01-30T20:17:04.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 603.93892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
15342025-01-30T20:17:04.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.196496588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
15352025-01-30T20:17:04.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 997.111398ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15362025-01-30T20:17:05.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.49193043s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
15372025-01-30T20:17:05.021ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15382025-01-30T20:17:05.022ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15392025-01-30T20:17:05.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 723.567031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15402025-01-30T20:17:05.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 883.645062ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
15412025-01-30T20:17:05.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.37934592s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
15422025-01-30T20:17:05.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 65.339688ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15432025-01-30T20:17:05.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 93.346785ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15442025-01-30T20:17:05.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 725.152354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15452025-01-30T20:17:05.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 137.264611ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15462025-01-30T20:17:05.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 714.517091ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15472025-01-30T20:17:05.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 977.219737ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
15482025-01-30T20:17:05.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.107664096s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
15492025-01-30T20:17:05.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 673.12324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
15502025-01-30T20:17:05.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.01380438s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
15512025-01-30T20:17:05.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 361.881504ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15522025-01-30T20:17:05.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 532.141254ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
15532025-01-30T20:17:05.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 511.204341ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15542025-01-30T20:17:05.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.092631761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
15552025-01-30T20:17:05.889ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15562025-01-30T20:17:05.889ZINFOSledAgent (ServiceManager): Booting oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15572025-01-30T20:17:05.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.190179006s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15582025-01-30T20:17:05.926ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15592025-01-30T20:17:05.926ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15602025-01-30T20:17:05.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.017632191s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
15612025-01-30T20:17:05.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 657.469932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15622025-01-30T20:17:05.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 569.190092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
15632025-01-30T20:17:06.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 43.479089ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15642025-01-30T20:17:06.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.406854427s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15652025-01-30T20:17:06.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 26.723883ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15662025-01-30T20:17:06.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 79.371381ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15672025-01-30T20:17:06.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 793.046586ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
15682025-01-30T20:17:06.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 72.81178ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15692025-01-30T20:17:06.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 1.253693995s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15702025-01-30T20:17:06.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 110.043452ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15712025-01-30T20:17:06.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.496165338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
15722025-01-30T20:17:06.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 235.018263ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15732025-01-30T20:17:06.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.342623824s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
15742025-01-30T20:17:06.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.05515427s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15752025-01-30T20:17:06.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 308.574572ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15762025-01-30T20:17:06.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.019138663s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
15772025-01-30T20:17:06.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 543.349687ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15782025-01-30T20:17:06.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 745.172199ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
15792025-01-30T20:17:06.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.487379014s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
15802025-01-30T20:17:06.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 586.954612ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
15812025-01-30T20:17:06.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 502.678527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
15822025-01-30T20:17:06.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 651.642706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
15832025-01-30T20:17:06.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.082736029s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
15842025-01-30T20:17:06.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 822.353312ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15852025-01-30T20:17:06.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 938.79571ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
15862025-01-30T20:17:06.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.41950507s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
15872025-01-30T20:17:06.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.461183518s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
15882025-01-30T20:17:07.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 778.846518ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
15892025-01-30T20:17:07.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 946.032467ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
15902025-01-30T20:17:07.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.190734249s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
15912025-01-30T20:17:07.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 672.494823ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
15922025-01-30T20:17:07.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 554.513057ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
15932025-01-30T20:17:07.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 666.389842ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
15942025-01-30T20:17:07.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 974.912248ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
15952025-01-30T20:17:07.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 1.174097774s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
15962025-01-30T20:17:07.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 519.299708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
15972025-01-30T20:17:07.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 972.514568ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
15982025-01-30T20:17:07.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 573.612816ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
15992025-01-30T20:17:07.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 870.282226ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
16002025-01-30T20:17:07.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.012739552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
16012025-01-30T20:17:07.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.26724501s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
16022025-01-30T20:17:07.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.074985876s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16032025-01-30T20:17:07.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.424612621s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
16042025-01-30T20:17:07.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.099025824s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16052025-01-30T20:17:07.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 954.54855ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16062025-01-30T20:17:07.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 822.384155ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
16072025-01-30T20:17:07.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.126141978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
16082025-01-30T20:17:08.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.098912092s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
16092025-01-30T20:17:08.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 605.03385ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16102025-01-30T20:17:08.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 648.455681ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
16112025-01-30T20:17:08.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 636.731141ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16122025-01-30T20:17:08.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 985.819368ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16132025-01-30T20:17:08.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.350233045s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
16142025-01-30T20:17:08.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.085351473s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
16152025-01-30T20:17:08.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 987.588221ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
16162025-01-30T20:17:08.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.380870708s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
16172025-01-30T20:17:08.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 1.209675653s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
16182025-01-30T20:17:08.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.438403989s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16192025-01-30T20:17:08.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.415120039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
16202025-01-30T20:17:08.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 872.250742ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
16212025-01-30T20:17:08.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.35536958s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
16222025-01-30T20:17:08.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 705.131281ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16232025-01-30T20:17:08.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 635.927247ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16242025-01-30T20:17:08.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 685.397398ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16252025-01-30T20:17:08.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 518.552382ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16262025-01-30T20:17:09.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 795.54465ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
16272025-01-30T20:17:09.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.02351986s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
16282025-01-30T20:17:09.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.373889381s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
16292025-01-30T20:17:09.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 812.939027ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
16302025-01-30T20:17:09.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 752.938981ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16312025-01-30T20:17:09.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 762.505326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
16322025-01-30T20:17:09.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.342760902s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16332025-01-30T20:17:09.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 598.834913ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16342025-01-30T20:17:09.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.440593358s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
16352025-01-30T20:17:09.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.434951871s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16362025-01-30T20:17:09.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 643.083867ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
16372025-01-30T20:17:09.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 737.193233ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16382025-01-30T20:17:09.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 610.39393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
16392025-01-30T20:17:09.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 898.64553ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
16402025-01-30T20:17:09.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.465296859s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
16412025-01-30T20:17:09.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 897.998736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
16422025-01-30T20:17:10.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.383031427s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
16432025-01-30T20:17:10.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 853.093445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16442025-01-30T20:17:10.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.156070542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16452025-01-30T20:17:10.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 959.589218ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
16462025-01-30T20:17:10.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.309693651s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
16472025-01-30T20:17:10.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.385751143s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
16482025-01-30T20:17:10.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 570.187648ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16492025-01-30T20:17:10.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.204329377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
16502025-01-30T20:17:10.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.132860741s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
16512025-01-30T20:17:10.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.057637243s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
16522025-01-30T20:17:10.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 629.816012ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16532025-01-30T20:17:10.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.297182946s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
16542025-01-30T20:17:10.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 716.112469ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
16552025-01-30T20:17:10.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.06665247s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
16562025-01-30T20:17:10.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.128299069s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16572025-01-30T20:17:10.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.395354086s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16582025-01-30T20:17:11.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.193193608s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16592025-01-30T20:17:11.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 752.733081ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
16602025-01-30T20:17:11.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 502.786192ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16612025-01-30T20:17:11.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 608.553588ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16622025-01-30T20:17:11.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 658.386079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
16632025-01-30T20:17:11.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.044648198s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
16642025-01-30T20:17:11.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 523.598868ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16652025-01-30T20:17:11.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 548.927475ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
16662025-01-30T20:17:11.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.463753385s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
16672025-01-30T20:17:11.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.123335028s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16682025-01-30T20:17:11.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.421119372s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
16692025-01-30T20:17:11.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 818.898246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
16702025-01-30T20:17:11.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 988.861071ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
16712025-01-30T20:17:11.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 893.825607ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
16722025-01-30T20:17:11.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.0855822s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
16732025-01-30T20:17:11.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 701.638501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16742025-01-30T20:17:11.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.335185854s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
16752025-01-30T20:17:11.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.292772588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
16762025-01-30T20:17:11.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 953.865421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16772025-01-30T20:17:11.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.294962784s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
16782025-01-30T20:17:11.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.491446176s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
16792025-01-30T20:17:11.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 582.71896ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16802025-01-30T20:17:12.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 970.997606ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
16812025-01-30T20:17:12.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 552.791502ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16822025-01-30T20:17:12.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 505.154702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16832025-01-30T20:17:12.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 804.972806ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
16842025-01-30T20:17:12.396ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16852025-01-30T20:17:12.396ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
16862025-01-30T20:17:12.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.499631649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
16872025-01-30T20:17:12.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.493667305s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
16882025-01-30T20:17:12.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.162959841s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
16892025-01-30T20:17:12.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 52.766981ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
16902025-01-30T20:17:12.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 93.643742ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
16912025-01-30T20:17:12.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 875.628343ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
16922025-01-30T20:17:12.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.010217292s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
16932025-01-30T20:17:12.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.211213016s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
16942025-01-30T20:17:12.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 211.298732ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
16952025-01-30T20:17:12.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.45470035s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
16962025-01-30T20:17:12.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 953.116909ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
16972025-01-30T20:17:12.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.014139591s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
16982025-01-30T20:17:12.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.168237056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
16992025-01-30T20:17:13.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 494.097485ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17002025-01-30T20:17:13.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 527.358637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
17012025-01-30T20:17:13.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 884.587509ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17022025-01-30T20:17:13.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.208085221s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17032025-01-30T20:17:13.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 530.059642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
17042025-01-30T20:17:13.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.479546509s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
17052025-01-30T20:17:13.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 761.707297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
17062025-01-30T20:17:13.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.17413847s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
17072025-01-30T20:17:13.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 800.437585ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
17082025-01-30T20:17:13.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 1.022578661s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17092025-01-30T20:17:13.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 515.550349ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
17102025-01-30T20:17:13.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.408615943s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
17112025-01-30T20:17:13.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.438101364s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
17122025-01-30T20:17:13.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.060741318s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
17132025-01-30T20:17:13.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.313917964s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17142025-01-30T20:17:13.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.272056992s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
17152025-01-30T20:17:13.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.120761207s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17162025-01-30T20:17:13.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 524.703796ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
17172025-01-30T20:17:13.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 878.695728ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
17182025-01-30T20:17:14.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.182326726s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
17192025-01-30T20:17:14.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.019554418s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17202025-01-30T20:17:14.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 716.432443ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17212025-01-30T20:17:14.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.224837148s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
17222025-01-30T20:17:14.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 1.435084678s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
17232025-01-30T20:17:14.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 830.260411ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
17242025-01-30T20:17:14.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 860.093897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
17252025-01-30T20:17:14.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.304570127s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
17262025-01-30T20:17:14.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 521.684912ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17272025-01-30T20:17:14.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.397017364s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
17282025-01-30T20:17:14.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 718.688135ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17292025-01-30T20:17:14.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.200524783s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
17302025-01-30T20:17:14.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 619.29118ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17312025-01-30T20:17:14.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 550.626361ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
17322025-01-30T20:17:14.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 1.437996366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
17332025-01-30T20:17:14.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.409544035s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17342025-01-30T20:17:15.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.420239202s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17352025-01-30T20:17:15.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.244323643s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
17362025-01-30T20:17:15.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.424737573s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17372025-01-30T20:17:15.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 628.078793ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
17382025-01-30T20:17:15.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 1.417071552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
17392025-01-30T20:17:15.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.294536743s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17402025-01-30T20:17:15.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 810.999398ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
17412025-01-30T20:17:15.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.035699919s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
17422025-01-30T20:17:15.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.319961831s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
17432025-01-30T20:17:15.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59672
17442025-01-30T20:17:15.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 735.960062ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17452025-01-30T20:17:15.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08") failed: Property not found. retry in 1.486140967s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
17462025-01-30T20:17:15.314ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53641 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59672 req_id = d0c3b416-3dab-4167-b06f-b33116f19d91 response_code = 200 uri = /baseboard
17472025-01-30T20:17:15.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 863.782595ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17482025-01-30T20:17:15.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.212099118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
17492025-01-30T20:17:15.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 702.68141ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
17502025-01-30T20:17:15.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 596.836616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
17512025-01-30T20:17:15.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 1.105523084s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
17522025-01-30T20:17:15.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 1.482223197s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
17532025-01-30T20:17:15.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.050235409s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
17542025-01-30T20:17:15.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28") failed: Property not found. retry in 1.287434608s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
17552025-01-30T20:17:16.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 638.518102ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17562025-01-30T20:17:16.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa") failed: Property not found. retry in 1.359777082s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
17572025-01-30T20:17:16.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 1.420917279s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
17582025-01-30T20:17:16.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 555.065096ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17592025-01-30T20:17:16.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 1.271409731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
17602025-01-30T20:17:16.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 1.413483282s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
17612025-01-30T20:17:16.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d") failed: Property not found. retry in 742.969881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
17622025-01-30T20:17:16.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.00083165s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17632025-01-30T20:17:16.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.287155915s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17642025-01-30T20:17:16.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 777.550701ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17652025-01-30T20:17:16.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 909.053044ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17662025-01-30T20:17:16.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed") failed: Property not found. retry in 779.84258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
17672025-01-30T20:17:16.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2") failed: Property not found. retry in 1.286065622s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
17682025-01-30T20:17:16.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 834.92721ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
17692025-01-30T20:17:16.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 696.075833ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17702025-01-30T20:17:16.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 985.856139ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
17712025-01-30T20:17:16.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248") failed: Property not found. retry in 1.252658711s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
17722025-01-30T20:17:16.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde") failed: Property not found. retry in 1.239656068s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
17732025-01-30T20:17:17.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 741.983606ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17742025-01-30T20:17:17.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 825.299748ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17752025-01-30T20:17:17.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a") failed: Property not found. retry in 941.717509ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
17762025-01-30T20:17:17.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 609.006848ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17772025-01-30T20:17:17.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.203026198s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17782025-01-30T20:17:17.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a") failed: Property not found. retry in 1.388394382s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
17792025-01-30T20:17:17.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291") failed: Property not found. retry in 541.104372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
17802025-01-30T20:17:17.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f") failed: Property not found. retry in 741.278557ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
17812025-01-30T20:17:17.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 820.140354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17822025-01-30T20:17:17.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f") failed: Property not found. retry in 685.150681ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
17832025-01-30T20:17:17.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f") failed: Property not found. retry in 580.273103ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
17842025-01-30T20:17:18.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.286876166s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17852025-01-30T20:17:18.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.424762361s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17862025-01-30T20:17:18.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 1.45445932s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17872025-01-30T20:17:18.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 698.715552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17882025-01-30T20:17:18.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 817.743981ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17892025-01-30T20:17:19.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.411914729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17902025-01-30T20:17:19.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.191709021s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17912025-01-30T20:17:19.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 771.019243ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17922025-01-30T20:17:19.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 610.432923ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17932025-01-30T20:17:19.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 846.319799ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17942025-01-30T20:17:20.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.043609234s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
17952025-01-30T20:17:20.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.007845026s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
17962025-01-30T20:17:20.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 897.994826ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
17972025-01-30T20:17:20.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 1.474596816s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
17982025-01-30T20:17:20.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 1.173208926s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
17992025-01-30T20:17:21.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 590.973212ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
18002025-01-30T20:17:21.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3") failed: Property not found. retry in 1.415695458s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
18012025-01-30T20:17:21.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4") failed: Property not found. retry in 1.471433422s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
18022025-01-30T20:17:21.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf") failed: Property not found. retry in 1.194819627s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
18032025-01-30T20:17:21.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343") failed: Property not found. retry in 809.120768ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
18042025-01-30T20:17:22.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396") failed: Property not found. retry in 1.451573599s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
18052025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_536196d0-1d62-4b76-a1f0-048d89f91f28
18062025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_8d5dfa3d-89df-4ed3-89f6-a30554d47abf
18072025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_clickhouse_94aca596-2d3a-41fa-b190-8ec8091a0396
18082025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_d72b58a3-5740-4826-8959-b97b4166d85a
18092025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_f8657d8f-a69b-4dfb-9355-447ac02b9343
18102025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_external_dns_db149fee-69cf-48fe-8393-2d952566bed4
18112025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_75755e9c-437c-480b-8cda-07a28b0dc2a3
18122025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_64e08b7b-0310-4251-a20b-2963dbea9fde
18132025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_66c3541c-6e49-42b2-96dc-595f0f10d5ed
18142025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_90f92d6a-77b5-41de-a00e-410469bf76aa
18152025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_3a2122fd-6e55-4422-b4a4-cbd1b4c5b04a
18162025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_external_dns_b855967f-1c83-48e6-a52e-bc2e41c4ec2f
18172025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_nexus_eab4c9c4-aff5-41de-a773-a76ade40cb0f
18182025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_pantry_a3e5a327-9dfd-478d-97c5-b64c085e6d6f
18192025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_ce48895d-4e58-4427-9e4c-eba683b07291
18202025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_623f9e2f-1569-44c6-9d6d-f26f14cc9d08
18212025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_bd9fdebb-f678-49c4-96ca-8fe5b4cc93d2
18222025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_oximeter_623434f7-1950-4ff8-a21d-872e401e4248
18232025-01-30T20:17:23.531ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3298 zone = oxz_crucible_8e22325b-faaf-4d80-9bba-9add9bffff4d
18242025-01-30T20:17:23.533ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18252025-01-30T20:17:23.541ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18262025-01-30T20:17:23.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38684382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43550 req_id = 2df11896-acb9-4743-a616-f89299572f10 response_code = 204 uri = /omicron-zones
18272025-01-30T20:17:23.605ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
18282025-01-30T20:17:23.654ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18292025-01-30T20:17:23.656ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
18302025-01-30T20:17:23.697ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
18312025-01-30T20:17:24.951ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 132.166955606s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
18322025-01-30T20:17:24.951ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18332025-01-30T20:17:25.067ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18342025-01-30T20:17:25.167ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18352025-01-30T20:17:25.253ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18362025-01-30T20:17:25.406ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18372025-01-30T20:17:25.518ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18382025-01-30T20:17:25.749ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18392025-01-30T20:17:26.122ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18402025-01-30T20:17:26.606ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18412025-01-30T20:17:26.830ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18422025-01-30T20:17:27.067ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18432025-01-30T20:17:27.609ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18442025-01-30T20:17:28.157ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18452025-01-30T20:17:29.215ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/6cd2152b-e0e7-4208-8446-3b1ba878a49f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
18462025-01-30T20:17:30.439ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7b17e030-a01f-48d0-8d0f-1a3354b4a88e", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"6cd2152b-e0e7-4208-8446-3b1ba878a49f\"", request_id: "7b17e030-a01f-48d0-8d0f-1a3354b4a88e" } file = sled-agent/src/rack_setup/service.rs:1070
18472025-01-30T20:17:32.323ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b35ee555-4ef7-4d28-b736-4a0bb3ab7f1e", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "b35ee555-4ef7-4d28-b736-4a0bb3ab7f1e" } file = sled-agent/src/rack_setup/service.rs:1070
18482025-01-30T20:17:34.802ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d5b2ed89-8e9a-400f-a6c1-e6491a9ce53d", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "d5b2ed89-8e9a-400f-a6c1-e6491a9ce53d" } file = sled-agent/src/rack_setup/service.rs:1070
18492025-01-30T20:17:37.632ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bc49dd15-94ea-4cb5-8b9f-e04eddd87db3", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "bc49dd15-94ea-4cb5-8b9f-e04eddd87db3" } file = sled-agent/src/rack_setup/service.rs:1070
18502025-01-30T20:17:39.673ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a245b1a6-697d-4f1f-a0b8-a56d58b54468", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "a245b1a6-697d-4f1f-a0b8-a56d58b54468" } file = sled-agent/src/rack_setup/service.rs:1070
18512025-01-30T20:17:43.221ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "96b6f9fc-dc29-4a7d-9fc8-288708584fa6", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "96b6f9fc-dc29-4a7d-9fc8-288708584fa6" } file = sled-agent/src/rack_setup/service.rs:1070
18522025-01-30T20:17:45.373ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54260
18532025-01-30T20:17:45.374ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54260 req_id = 8b81af86-50fc-4391-a84f-ec3286c65040 response_code = 200 uri = /baseboard
18542025-01-30T20:17:45.868ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "298be633-7b97-488c-bd48-9e83145f1e7d", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "298be633-7b97-488c-bd48-9e83145f1e7d" } file = sled-agent/src/rack_setup/service.rs:1070
18552025-01-30T20:17:48.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9b9700c9-d4f7-4976-a536-60127fdab6ad", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "9b9700c9-d4f7-4976-a536-60127fdab6ad" } file = sled-agent/src/rack_setup/service.rs:1070
18562025-01-30T20:17:51.079ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3049bb15-7288-4944-acb7-fa0ff3946d10", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "3049bb15-7288-4944-acb7-fa0ff3946d10" } file = sled-agent/src/rack_setup/service.rs:1070
18572025-01-30T20:17:54.186ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d833eb02-e096-4dfe-a7f0-30288e429778", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "d833eb02-e096-4dfe-a7f0-30288e429778" } file = sled-agent/src/rack_setup/service.rs:1070
18582025-01-30T20:17:58.496ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "14ddc28d-62b7-4711-928c-4d4ea6d7391f", "content-length": "173", "date": "Thu, 30 Jan 2025 20:17:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "14ddc28d-62b7-4711-928c-4d4ea6d7391f" } file = sled-agent/src/rack_setup/service.rs:1070
18592025-01-30T20:18:06.762ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "49772236-d7f7-4d28-a7c6-43b1580c8516", "content-length": "173", "date": "Thu, 30 Jan 2025 20:18:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"80be2cf5-c1f1-42e5-8353-289dd0bb621a\"", request_id: "49772236-d7f7-4d28-a7c6-43b1580c8516" } file = sled-agent/src/rack_setup/service.rs:1070
18602025-01-30T20:18:10.770ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
18612025-01-30T20:18:10.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62242
18622025-01-30T20:18:10.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18632025-01-30T20:18:10.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18642025-01-30T20:18:10.973ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
18652025-01-30T20:18:10.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
18662025-01-30T20:18:10.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18672025-01-30T20:18:10.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_267308a4-806f-4489-9002-d2fdc6345ade
18682025-01-30T20:18:11.011ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18692025-01-30T20:18:11.011ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2
18702025-01-30T20:18:11.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18712025-01-30T20:18:11.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7414a064-4217-4398-b36a-c06130bcb569
18722025-01-30T20:18:11.054ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18732025-01-30T20:18:11.054ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d
18742025-01-30T20:18:11.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18752025-01-30T20:18:11.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad
18762025-01-30T20:18:11.095ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18772025-01-30T20:18:11.095ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e
18782025-01-30T20:18:11.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18792025-01-30T20:18:11.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f
18802025-01-30T20:18:11.140ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18812025-01-30T20:18:11.140ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9
18822025-01-30T20:18:11.162ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18832025-01-30T20:18:11.162ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04f8928-4530-4288-b470-e4b4780b8353
18842025-01-30T20:18:11.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62242 req_id = 9542a3b0-25ea-438e-b645-f59ba08312e0 response_code = 200 uri = /inventory
18852025-01-30T20:18:13.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34419
18862025-01-30T20:18:13.384ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18872025-01-30T20:18:13.385ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18882025-01-30T20:18:13.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18892025-01-30T20:18:13.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18902025-01-30T20:18:13.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18912025-01-30T20:18:13.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18922025-01-30T20:18:13.387ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18932025-01-30T20:18:13.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34419 req_id = b7b2a8c0-9f7a-41db-8ca6-2360f7e890e7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18942025-01-30T20:18:13.388ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
18952025-01-30T20:18:13.393ZINFOSledAgent (RSS): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18962025-01-30T20:18:13.394ZINFOSledAgent (RSS): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18972025-01-30T20:18:13.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46104
18982025-01-30T20:18:13.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18992025-01-30T20:18:13.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19002025-01-30T20:18:13.724ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
19012025-01-30T20:18:13.726ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
19022025-01-30T20:18:13.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19032025-01-30T20:18:13.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_267308a4-806f-4489-9002-d2fdc6345ade
19042025-01-30T20:18:13.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50001
19052025-01-30T20:18:13.744ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19062025-01-30T20:18:13.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19072025-01-30T20:18:13.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19082025-01-30T20:18:13.744ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19092025-01-30T20:18:13.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19102025-01-30T20:18:13.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19112025-01-30T20:18:13.745ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19122025-01-30T20:18:13.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50001 req_id = f3e8b747-78c2-44e6-9722-92ce9433fe86 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19132025-01-30T20:18:13.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19142025-01-30T20:18:13.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2
19152025-01-30T20:18:13.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19162025-01-30T20:18:13.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7414a064-4217-4398-b36a-c06130bcb569
19172025-01-30T20:18:13.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19182025-01-30T20:18:13.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d
19192025-01-30T20:18:13.829ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19202025-01-30T20:18:13.829ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad
19212025-01-30T20:18:13.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19222025-01-30T20:18:13.849ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e
19232025-01-30T20:18:13.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19242025-01-30T20:18:13.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f
19252025-01-30T20:18:13.889ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19262025-01-30T20:18:13.889ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9
19272025-01-30T20:18:13.912ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19282025-01-30T20:18:13.912ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04f8928-4530-4288-b470-e4b4780b8353
19292025-01-30T20:18:13.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46104 req_id = 6ae25a15-d939-465b-a79f-b73dcfc981b1 response_code = 200 uri = /inventory
19302025-01-30T20:18:14.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34114
19312025-01-30T20:18:14.449ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19322025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19332025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19342025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19352025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19372025-01-30T20:18:14.450ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19382025-01-30T20:18:14.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34114 req_id = 8acb4c90-6168-4a3f-98e9-be96f041ada1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19392025-01-30T20:18:14.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36531
19402025-01-30T20:18:14.494ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19412025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19422025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19432025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19442025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19462025-01-30T20:18:14.495ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19472025-01-30T20:18:14.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36531 req_id = ee18c48e-1794-40b6-b3ca-2f32fd4f882d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19482025-01-30T20:18:15.425ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43736
19492025-01-30T20:18:15.425ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43736 req_id = 8b69456a-732e-4c95-bc64-375e52d5aea8 response_code = 200 uri = /baseboard
19502025-01-30T20:18:21.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35745
19512025-01-30T20:18:21.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 792 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35745 req_id = afc25741-5e79-446f-a096-7cb4bbe42761 response_code = 200 uri = /vpc-routes
19522025-01-30T20:18:21.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
19532025-01-30T20:18:21.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 777 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35745 req_id = 1cb2ddaf-55be-47b5-8395-0614e8008165 response_code = 204 uri = /eip-gateways
19542025-01-30T20:18:21.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35745 req_id = dbe9cafc-7d3c-4658-9ac1-d70077402f0c response_code = 204 uri = /vpc-routes
19552025-01-30T20:18:31.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38022
19562025-01-30T20:18:31.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38022 req_id = e9118a49-6082-4e75-a166-c624d6a4719d response_code = 200 uri = /vpc-routes
19572025-01-30T20:18:31.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35083
19582025-01-30T20:18:31.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 571 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35083 req_id = c1597330-c6c9-4ca9-aae5-8e6e8aa61972 response_code = 200 uri = /v2p
19592025-01-30T20:18:31.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
19602025-01-30T20:18:31.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38022 req_id = 30c8ead0-9ccd-4a67-a008-11c322f01115 response_code = 204 uri = /eip-gateways
19612025-01-30T20:18:31.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38022 req_id = 343235ea-7057-42b8-9458-aebd5c75041f response_code = 204 uri = /vpc-routes
19622025-01-30T20:18:31.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37160
19632025-01-30T20:18:31.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37160 req_id = 59331d14-6f2c-4fc9-9f27-064cc4653062 response_code = 200 uri = /vpc-routes
19642025-01-30T20:18:31.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55372
19652025-01-30T20:18:31.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55372 req_id = cada94d9-6319-4c17-9090-cb5486915705 response_code = 200 uri = /vpc-routes
19662025-01-30T20:18:31.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
19672025-01-30T20:18:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37160 req_id = 027ddee2-333e-4d4c-8728-32e601110324 response_code = 204 uri = /eip-gateways
19682025-01-30T20:18:31.529ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
19692025-01-30T20:18:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55372 req_id = 7753844f-093d-4e9c-a4b5-40a1b534489b response_code = 204 uri = /eip-gateways
19702025-01-30T20:18:31.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55372 req_id = 8c7de3a4-f454-4b91-9008-6ecbd28dc8c8 response_code = 204 uri = /vpc-routes
19712025-01-30T20:18:31.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56543
19722025-01-30T20:18:31.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56543 req_id = 341ea58d-9b1a-47af-afb9-a2abb4a7cc58 response_code = 200 uri = /v2p
19732025-01-30T20:18:31.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 760 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37160 req_id = 608a2125-a3bd-4dc5-9ba2-347710c7cf85 response_code = 204 uri = /vpc-routes
19742025-01-30T20:18:31.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39467
19752025-01-30T20:18:31.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19762025-01-30T20:18:31.745ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19772025-01-30T20:18:31.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39467 req_id = 6253ede3-ef1c-46d9-a36e-0e55d29b8a1c response_code = 204 uri = /switch-ports
19782025-01-30T20:18:31.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44527
19792025-01-30T20:18:31.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32832
19802025-01-30T20:18:31.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19812025-01-30T20:18:31.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32832 req_id = 5bd8acd4-a2d0-46be-a566-27fc1d060e12 response_code = 200 uri = /v2p
19822025-01-30T20:18:31.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7943 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39467 req_id = 672c8ebb-85ef-4219-ab15-7aed24ccbe5f response_code = 200 uri = /network-bootstore-config
19832025-01-30T20:18:31.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19842025-01-30T20:18:31.859ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19852025-01-30T20:18:31.863ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19862025-01-30T20:18:31.864ZINFOSledAgent (bootstore): Writing ledger to /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19872025-01-30T20:18:31.865ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19882025-01-30T20:18:31.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10613 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39467 req_id = 29cbc1d8-88b8-4362-94da-3ed73ed52809 response_code = 204 uri = /network-bootstore-config
19892025-01-30T20:18:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44527 req_id = 3d8782f3-a090-417c-a340-ae027143b4f9 response_code = 204 uri = /switch-ports
19902025-01-30T20:18:31.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44527 req_id = 5d1a17f8-0b6f-4223-8bed-7f3f109b794a response_code = 200 uri = /network-bootstore-config
19912025-01-30T20:18:31.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47588
19922025-01-30T20:18:31.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
19932025-01-30T20:18:31.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
19942025-01-30T20:18:32.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47588 req_id = 87639f3c-92a4-412a-923c-5fce8b03d812 response_code = 204 uri = /switch-ports
19952025-01-30T20:18:32.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47588 req_id = 04ab74f1-1117-4af1-8d72-203e8a9a7ae7 response_code = 200 uri = /network-bootstore-config
19962025-01-30T20:18:45.462ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59764
19972025-01-30T20:18:45.462ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59764 req_id = da4f21e5-1141-416a-a214-a7394bfba533 response_code = 200 uri = /baseboard
19982025-01-30T20:19:01.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39141
19992025-01-30T20:19:01.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39141 req_id = 2f5f479e-786d-41e8-8b64-d708da9681cf response_code = 200 uri = /vpc-routes
20002025-01-30T20:19:01.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59475
20012025-01-30T20:19:01.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59475 req_id = 9d68fae9-cece-424c-8ad7-cf4833845da0 response_code = 200 uri = /v2p
20022025-01-30T20:19:01.110ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20032025-01-30T20:19:01.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39141 req_id = aa87696c-9052-4a33-8e08-6ef18525f8b4 response_code = 204 uri = /eip-gateways
20042025-01-30T20:19:01.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39141 req_id = 7b889cce-2b90-41e6-977b-12271afb9b91 response_code = 204 uri = /vpc-routes
20052025-01-30T20:19:01.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51437
20062025-01-30T20:19:01.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51437 req_id = 3a42fa5f-9516-4a53-90b0-9dbeeb5ed34a response_code = 200 uri = /vpc-routes
20072025-01-30T20:19:01.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20082025-01-30T20:19:01.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51437 req_id = 3cbde6f4-99f7-4ad5-bec7-9ac58beae42a response_code = 204 uri = /eip-gateways
20092025-01-30T20:19:01.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51437 req_id = b2a868b6-1054-4655-8926-7a5b64096a7e response_code = 204 uri = /vpc-routes
20102025-01-30T20:19:01.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55341
20112025-01-30T20:19:01.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38953
20122025-01-30T20:19:01.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20132025-01-30T20:19:01.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55341 req_id = 959bb300-6313-440a-bb17-4e48e10ec838 response_code = 200 uri = /vpc-routes
20142025-01-30T20:19:01.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52540
20152025-01-30T20:19:01.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52540 req_id = 897a53c3-f1f2-45d2-aafc-758db533b659 response_code = 200 uri = /v2p
20162025-01-30T20:19:01.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20172025-01-30T20:19:01.517ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20182025-01-30T20:19:01.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55341 req_id = d26b60eb-f5d0-4347-90df-26a76887c3bd response_code = 204 uri = /eip-gateways
20192025-01-30T20:19:01.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55341 req_id = 77a441e1-7535-46e3-a432-4fa80c36c592 response_code = 204 uri = /vpc-routes
20202025-01-30T20:19:01.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46863
20212025-01-30T20:19:01.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46863 req_id = 92944b2d-96a4-4055-af6d-60ca9695fc6c response_code = 200 uri = /v2p
20222025-01-30T20:19:01.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109334 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38953 req_id = 3edda81f-7b7a-4b7d-aaf4-c4141c2c3003 response_code = 204 uri = /switch-ports
20232025-01-30T20:19:01.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38953 req_id = f990e6d9-65f7-46b7-832b-02706c3fa6e2 response_code = 200 uri = /network-bootstore-config
20242025-01-30T20:19:01.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45442
20252025-01-30T20:19:01.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20262025-01-30T20:19:01.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20272025-01-30T20:19:01.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45442 req_id = 5b15ea5a-acc4-45d4-b57c-a3c81006a140 response_code = 204 uri = /switch-ports
20282025-01-30T20:19:01.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56692
20292025-01-30T20:19:01.662ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20302025-01-30T20:19:01.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45442 req_id = 02034a51-7dcd-4140-83e6-e4f5868ddc35 response_code = 200 uri = /network-bootstore-config
20312025-01-30T20:19:01.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20322025-01-30T20:19:01.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56692 req_id = 1d56cc0c-4c6c-43e8-9b72-7f97ac0e78ef response_code = 204 uri = /switch-ports
20332025-01-30T20:19:01.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56692 req_id = c2955367-f159-4b79-95de-29e425a6f294 response_code = 200 uri = /network-bootstore-config
20342025-01-30T20:19:15.496ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60358
20352025-01-30T20:19:15.496ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60358 req_id = 201df698-fe66-4c08-9be1-5adef351ec4b response_code = 200 uri = /baseboard
20362025-01-30T20:19:31.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53146
20372025-01-30T20:19:31.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53146 req_id = 5a477db7-e3fb-486a-ae31-53b09c6c0e23 response_code = 200 uri = /vpc-routes
20382025-01-30T20:19:31.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20392025-01-30T20:19:31.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53146 req_id = 1c2e300b-f74b-4b7d-bc42-041f2229220d response_code = 204 uri = /eip-gateways
20402025-01-30T20:19:31.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53146 req_id = 8f862952-f252-42fd-8dde-2bee0b82c33f response_code = 204 uri = /vpc-routes
20412025-01-30T20:19:31.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43630
20422025-01-30T20:19:31.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 3b5b2b47-3189-4508-9b52-f81c449656e7 response_code = 200 uri = /vpc-routes
20432025-01-30T20:19:31.455ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20442025-01-30T20:19:31.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 1852cd80-27d4-4ca3-b669-674c7e95bb63 response_code = 204 uri = /eip-gateways
20452025-01-30T20:19:31.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43630 req_id = 8cdc517f-cc5b-4e07-b1e5-cee8d98731e3 response_code = 204 uri = /vpc-routes
20462025-01-30T20:19:31.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34189
20472025-01-30T20:19:31.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34189 req_id = ea0af6a4-9eee-4989-a506-a1e6f015622b response_code = 200 uri = /v2p
20482025-01-30T20:19:31.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44857
20492025-01-30T20:19:31.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20502025-01-30T20:19:31.551ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20512025-01-30T20:19:31.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44857 req_id = eba93efb-0a8a-4ace-aeec-1909f51289ef response_code = 204 uri = /switch-ports
20522025-01-30T20:19:31.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44857 req_id = 23aea336-80a5-4a75-a595-b825845ebaf3 response_code = 200 uri = /network-bootstore-config
20532025-01-30T20:19:31.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52079
20542025-01-30T20:19:31.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20552025-01-30T20:19:31.648ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20562025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52079 req_id = bd215649-a56a-4610-8a0e-f8300d0d2457 response_code = 204 uri = /switch-ports
20572025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53127
20582025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61846
20592025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39464
20602025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52079 req_id = c382b4ab-1aba-4a52-98ae-e84f4b206e93 response_code = 200 uri = /network-bootstore-config
20612025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53127 req_id = 3ff5ff46-40b0-4cef-88dc-8c3a040e2e3b response_code = 200 uri = /v2p
20622025-01-30T20:19:31.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39464 req_id = b025ce21-d2d6-445c-b7bb-a1a13cc64325 response_code = 200 uri = /v2p
20632025-01-30T20:19:31.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61846 req_id = 91a7c907-1ec6-4aa0-a2c7-c137201d0b7e response_code = 200 uri = /vpc-routes
20642025-01-30T20:19:31.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20652025-01-30T20:19:31.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61846 req_id = 21d8d706-dab3-4059-bc19-94eaaf635920 response_code = 204 uri = /eip-gateways
20662025-01-30T20:19:31.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61846 req_id = ffd2e6c4-9330-4aa5-b932-21cb9b99405a response_code = 204 uri = /vpc-routes
20672025-01-30T20:19:31.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37621
20682025-01-30T20:19:31.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20692025-01-30T20:19:31.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20702025-01-30T20:19:31.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37621 req_id = 8457cdea-1ac1-41c8-ae77-c98a5c8590ce response_code = 204 uri = /switch-ports
20712025-01-30T20:19:31.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37621 req_id = c56d51cf-de40-46ae-b989-6ef158ba8fa9 response_code = 200 uri = /network-bootstore-config
20722025-01-30T20:19:45.529ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42607
20732025-01-30T20:19:45.529ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42607 req_id = edc302bc-dec9-4ec8-b29e-cc6bf013cd45 response_code = 200 uri = /baseboard
20742025-01-30T20:20:01.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35653
20752025-01-30T20:20:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35653 req_id = b6f3bb03-7e75-429b-b210-7d17edb90f25 response_code = 200 uri = /v2p
20762025-01-30T20:20:01.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65035
20772025-01-30T20:20:01.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65035 req_id = 34cfd4a5-313c-4969-9b09-98262d787d87 response_code = 200 uri = /vpc-routes
20782025-01-30T20:20:01.124ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20792025-01-30T20:20:01.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65035 req_id = 31156b9d-3796-4124-8886-6580de315600 response_code = 204 uri = /eip-gateways
20802025-01-30T20:20:01.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65035 req_id = 3320b2bb-f32b-4562-aa95-b71630d3fd24 response_code = 204 uri = /vpc-routes
20812025-01-30T20:20:01.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51041
20822025-01-30T20:20:01.236ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20832025-01-30T20:20:01.289ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20842025-01-30T20:20:01.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51041 req_id = 998c9c1c-ab4b-4d54-88df-2692fc0cc51e response_code = 204 uri = /switch-ports
20852025-01-30T20:20:01.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57614
20862025-01-30T20:20:01.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57614 req_id = 1a6d18d5-3d02-48fc-8996-98c502f84966 response_code = 200 uri = /vpc-routes
20872025-01-30T20:20:01.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51041 req_id = 4b47b552-8124-4344-906a-febcbdcbb23c response_code = 200 uri = /network-bootstore-config
20882025-01-30T20:20:01.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43960
20892025-01-30T20:20:01.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43960 req_id = 19d12e55-d0c1-4d7e-ac1b-a86c0980c3a6 response_code = 200 uri = /vpc-routes
20902025-01-30T20:20:01.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20912025-01-30T20:20:01.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57614 req_id = 3dac1da8-f0a5-4992-beb3-026397a08c1d response_code = 204 uri = /eip-gateways
20922025-01-30T20:20:01.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57614 req_id = 466708fc-8d11-4b61-891a-e7da4eb5246f response_code = 204 uri = /vpc-routes
20932025-01-30T20:20:01.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
20942025-01-30T20:20:01.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43960 req_id = 20caaae1-4976-4f1e-b47a-5888784af993 response_code = 204 uri = /eip-gateways
20952025-01-30T20:20:01.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43960 req_id = 3343acf9-328f-4c37-a8b3-26b34da14098 response_code = 204 uri = /vpc-routes
20962025-01-30T20:20:01.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40947
20972025-01-30T20:20:01.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
20982025-01-30T20:20:01.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
20992025-01-30T20:20:01.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40947 req_id = 0a2f48b7-e5d5-428e-9c05-1b038754d8ae response_code = 204 uri = /switch-ports
21002025-01-30T20:20:01.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33031
21012025-01-30T20:20:01.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40658
21022025-01-30T20:20:01.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52139
21032025-01-30T20:20:01.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52139 req_id = 4f0946d6-ed2b-4060-a7ac-3fe9b66d0571 response_code = 200 uri = /v2p
21042025-01-30T20:20:01.583ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21052025-01-30T20:20:01.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40947 req_id = 9486914a-921a-4641-bfe5-cd3c9ab2530e response_code = 200 uri = /network-bootstore-config
21062025-01-30T20:20:01.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 483 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40658 req_id = c8d8d99f-97e5-4661-9ab9-4a5a938125fa response_code = 200 uri = /v2p
21072025-01-30T20:20:01.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21082025-01-30T20:20:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33031 req_id = e982c6c0-75a8-4a44-88a4-c03cc3e86484 response_code = 204 uri = /switch-ports
21092025-01-30T20:20:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33031 req_id = 0383855a-d9c3-44af-8326-285bb9cb7ea4 response_code = 200 uri = /network-bootstore-config
21102025-01-30T20:20:15.563ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34384
21112025-01-30T20:20:15.563ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34384 req_id = 28f82254-d0d3-4d0d-8d27-3d300efb5a08 response_code = 200 uri = /baseboard
21122025-01-30T20:20:17.449ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:52655 remote_addr = [fd00:1122:3344:101::d]:37331 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
21132025-01-30T20:20:17.496ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46123 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = fe3e7b79-fd08-489d-925e-3ddfdbc2a6fb response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
21142025-01-30T20:20:31.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52897
21152025-01-30T20:20:31.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52897 req_id = 09c5b96f-adb2-4088-be1a-a9dd39683ce7 response_code = 200 uri = /vpc-routes
21162025-01-30T20:20:31.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35378
21172025-01-30T20:20:31.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21182025-01-30T20:20:31.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21192025-01-30T20:20:31.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35378 req_id = 63013057-65a2-4a5a-a77a-cc9cf3356895 response_code = 204 uri = /switch-ports
21202025-01-30T20:20:31.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43848
21212025-01-30T20:20:31.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21222025-01-30T20:20:31.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52897 req_id = bf2b5050-0bda-4de8-a5bc-e09821a47a09 response_code = 204 uri = /eip-gateways
21232025-01-30T20:20:31.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35378 req_id = eadb667c-54d5-4285-be7a-22690d255c25 response_code = 200 uri = /network-bootstore-config
21242025-01-30T20:20:31.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43848 req_id = 11fc8795-acca-4607-9343-630baf17f457 response_code = 200 uri = /v2p
21252025-01-30T20:20:31.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52897 req_id = 7f1b0574-21b6-41db-9c40-e48269d554f0 response_code = 204 uri = /vpc-routes
21262025-01-30T20:20:31.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60004
21272025-01-30T20:20:31.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60004 req_id = 358b079f-9622-4929-8cb4-8c5e600f1957 response_code = 200 uri = /vpc-routes
21282025-01-30T20:20:31.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21292025-01-30T20:20:31.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60004 req_id = 4d2f367a-97c5-4335-b1b6-1a011ab51300 response_code = 204 uri = /eip-gateways
21302025-01-30T20:20:31.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60004 req_id = 22333dbf-b828-4e16-b4f9-e71cbab3985e response_code = 204 uri = /vpc-routes
21312025-01-30T20:20:31.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34137
21322025-01-30T20:20:31.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34137 req_id = 486f4452-1fc0-4660-83e4-c1c4232bff91 response_code = 200 uri = /vpc-routes
21332025-01-30T20:20:31.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21342025-01-30T20:20:31.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34137 req_id = 670809bf-323a-459b-9b34-599ce4e3aea0 response_code = 204 uri = /eip-gateways
21352025-01-30T20:20:31.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34137 req_id = dc9dd5b7-93d6-4d42-bbce-74faf710e4f3 response_code = 204 uri = /vpc-routes
21362025-01-30T20:20:31.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34611
21372025-01-30T20:20:31.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34611 req_id = d84da625-6e6f-430b-9df8-a2a35bea5eec response_code = 200 uri = /v2p
21382025-01-30T20:20:31.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51413
21392025-01-30T20:20:31.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51413 req_id = 28b63dff-a036-4356-95b7-53e8258b1434 response_code = 200 uri = /v2p
21402025-01-30T20:20:31.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36391
21412025-01-30T20:20:31.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21422025-01-30T20:20:31.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21432025-01-30T20:20:31.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36391 req_id = 89600267-804c-4845-996d-f9728a3b460d response_code = 204 uri = /switch-ports
21442025-01-30T20:20:31.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41105
21452025-01-30T20:20:31.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21462025-01-30T20:20:31.937ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21472025-01-30T20:20:31.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41105 req_id = b098e922-7f27-4acd-ad3e-5f64d8b45c3d response_code = 204 uri = /switch-ports
21482025-01-30T20:20:31.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36391 req_id = e6e46615-1851-496d-a7ef-22305fe8e8fc response_code = 200 uri = /network-bootstore-config
21492025-01-30T20:20:31.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41105 req_id = 870ec34f-2bb1-4c1f-9cc2-0610eb99cf2f response_code = 200 uri = /network-bootstore-config
21502025-01-30T20:20:45.596ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33873
21512025-01-30T20:20:45.596ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33873 req_id = 0862b81a-8cd7-4f09-b226-4f77f8dd42c9 response_code = 200 uri = /baseboard
21522025-01-30T20:20:47.455ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6268 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = bb3a4fb8-0d1b-4803-88e1-b717865d6efe response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
21532025-01-30T20:21:01.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64475
21542025-01-30T20:21:01.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64475 req_id = 041aa519-0d74-416e-9e64-35dc7270fcb8 response_code = 200 uri = /vpc-routes
21552025-01-30T20:21:01.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21562025-01-30T20:21:01.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64475 req_id = 50326cd3-f770-40c3-9462-461ebf460422 response_code = 204 uri = /eip-gateways
21572025-01-30T20:21:01.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46349
21582025-01-30T20:21:01.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46349 req_id = 58a7d41b-75c5-4dc9-8e6e-660a2759728e response_code = 200 uri = /v2p
21592025-01-30T20:21:01.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64475 req_id = 12d75e47-5129-4e98-b614-a3a9cb3c8ec3 response_code = 204 uri = /vpc-routes
21602025-01-30T20:21:01.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56455
21612025-01-30T20:21:01.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21622025-01-30T20:21:01.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21632025-01-30T20:21:01.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56455 req_id = e4301530-c9a1-4aeb-b377-9b56d2975313 response_code = 204 uri = /switch-ports
21642025-01-30T20:21:01.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56455 req_id = a06fe0c4-a9b3-4dce-a9ee-4e1d7d3cdd59 response_code = 200 uri = /network-bootstore-config
21652025-01-30T20:21:01.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41687
21662025-01-30T20:21:01.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41687 req_id = 2ce3688f-aa5e-420d-a299-68fa018556d0 response_code = 200 uri = /vpc-routes
21672025-01-30T20:21:01.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21682025-01-30T20:21:01.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41687 req_id = 94be0fa3-e861-4384-9de3-5555f3e65774 response_code = 204 uri = /eip-gateways
21692025-01-30T20:21:01.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41687 req_id = bb0461d2-21b1-47e0-a083-1f9ef6c49c50 response_code = 204 uri = /vpc-routes
21702025-01-30T20:21:01.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39246
21712025-01-30T20:21:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39246 req_id = 6df966a4-6ffc-4331-a68b-9516c046dfb9 response_code = 200 uri = /vpc-routes
21722025-01-30T20:21:01.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59293
21732025-01-30T20:21:01.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59293 req_id = de93ce0b-893b-41ff-8446-7ed098d16ea9 response_code = 200 uri = /v2p
21742025-01-30T20:21:01.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48798
21752025-01-30T20:21:01.475ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21762025-01-30T20:21:01.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21772025-01-30T20:21:01.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48798 req_id = 97e5923c-54fc-445f-87dd-b579bf2299af response_code = 204 uri = /switch-ports
21782025-01-30T20:21:01.572ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21792025-01-30T20:21:01.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50555
21802025-01-30T20:21:01.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39246 req_id = b6da5e41-f17c-48b8-8669-7ebe97e9e190 response_code = 204 uri = /eip-gateways
21812025-01-30T20:21:01.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50555 req_id = ba7b7798-2b02-4e88-9f28-fea07f415550 response_code = 200 uri = /v2p
21822025-01-30T20:21:01.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48798 req_id = e4473c05-2568-41c1-82b4-792f99eb19a2 response_code = 200 uri = /network-bootstore-config
21832025-01-30T20:21:01.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39246 req_id = d2e7712b-5bdf-495b-b78e-45cf93722e9c response_code = 204 uri = /vpc-routes
21842025-01-30T20:21:01.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54491
21852025-01-30T20:21:01.584ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21862025-01-30T20:21:01.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
21872025-01-30T20:21:01.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = a79ae237-c0a1-4404-aaf2-74e75c379bb4 response_code = 204 uri = /switch-ports
21882025-01-30T20:21:01.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54491 req_id = c85c916b-b0c9-4484-be56-120796c69750 response_code = 200 uri = /network-bootstore-config
21892025-01-30T20:21:15.628ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50946
21902025-01-30T20:21:15.629ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 678 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50946 req_id = efbe97fa-080c-4a65-899a-6283796a1612 response_code = 200 uri = /baseboard
21912025-01-30T20:21:17.455ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5823 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = de5d9534-a930-45be-8785-662bf567eea1 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
21922025-01-30T20:21:31.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42607
21932025-01-30T20:21:31.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42607 req_id = 6963b530-0d24-43e5-ad9b-d0127bda20d9 response_code = 200 uri = /vpc-routes
21942025-01-30T20:21:31.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
21952025-01-30T20:21:31.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42607 req_id = c25c44d1-7f7a-4bb4-b51e-3d946b1b2855 response_code = 204 uri = /eip-gateways
21962025-01-30T20:21:31.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42607 req_id = 6783fd6d-6bb3-4da5-b97b-5926a1ee3b4d response_code = 204 uri = /vpc-routes
21972025-01-30T20:21:31.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57680
21982025-01-30T20:21:31.350ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
21992025-01-30T20:21:31.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22002025-01-30T20:21:31.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57680 req_id = 203648b8-3c60-444e-b704-b64c68c96f78 response_code = 204 uri = /switch-ports
22012025-01-30T20:21:31.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60369
22022025-01-30T20:21:31.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60369 req_id = a8c32b8f-0aab-48de-8653-4d41b7e227c2 response_code = 200 uri = /v2p
22032025-01-30T20:21:31.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57680 req_id = 5a0a082e-a5d3-46fc-b5fc-a26eb73758c6 response_code = 200 uri = /network-bootstore-config
22042025-01-30T20:21:31.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45731
22052025-01-30T20:21:31.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45731 req_id = 5f812b78-e0ac-49c1-9a2f-2b1a0c07df75 response_code = 200 uri = /vpc-routes
22062025-01-30T20:21:31.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22072025-01-30T20:21:31.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45731 req_id = 325d6caf-800d-4903-9e02-bf79b99bd575 response_code = 204 uri = /eip-gateways
22082025-01-30T20:21:31.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45731 req_id = 73778cc7-267b-496a-b34c-e3bf6376a211 response_code = 204 uri = /vpc-routes
22092025-01-30T20:21:31.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41372
22102025-01-30T20:21:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41372 req_id = 931a0225-80e7-4e70-b1bc-631f47e37724 response_code = 200 uri = /vpc-routes
22112025-01-30T20:21:31.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22122025-01-30T20:21:31.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41372 req_id = aba4fb3c-16c1-470a-9e63-5664074f585d response_code = 204 uri = /eip-gateways
22132025-01-30T20:21:31.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41372 req_id = 2264fbd9-1e54-4b88-ae61-d89f18275cc3 response_code = 204 uri = /vpc-routes
22142025-01-30T20:21:31.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45494
22152025-01-30T20:21:31.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45494 req_id = 2d2fb91c-4ab1-4c83-a694-94015791297a response_code = 200 uri = /v2p
22162025-01-30T20:21:31.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50337
22172025-01-30T20:21:31.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50337 req_id = 95bc95c1-1b39-4d9e-bc27-306a89fb2c21 response_code = 200 uri = /v2p
22182025-01-30T20:21:31.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57521
22192025-01-30T20:21:31.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22202025-01-30T20:21:31.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22212025-01-30T20:21:31.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57521 req_id = f7939af9-6de8-4095-8b9c-5e6ddfb165b5 response_code = 204 uri = /switch-ports
22222025-01-30T20:21:31.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52237
22232025-01-30T20:21:31.778ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22242025-01-30T20:21:31.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57521 req_id = 965a41f3-6023-4aa8-9c10-60e9ef5254b0 response_code = 200 uri = /network-bootstore-config
22252025-01-30T20:21:31.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22262025-01-30T20:21:31.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52237 req_id = c21e8553-1bb0-4424-995c-a28de0727bfd response_code = 204 uri = /switch-ports
22272025-01-30T20:21:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52237 req_id = 21b31198-a6be-4791-a4b5-ad51d2d9d625 response_code = 200 uri = /network-bootstore-config
22282025-01-30T20:21:45.661ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33365
22292025-01-30T20:21:45.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33365 req_id = 96878a90-c3d0-4e68-8855-d95ce4ca7e84 response_code = 200 uri = /baseboard
22302025-01-30T20:21:47.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6063 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 38277d7c-b3ff-4f1c-9359-8cc2d2f90338 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
22312025-01-30T20:22:01.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38646
22322025-01-30T20:22:01.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38646 req_id = 9de9c5c8-470f-43ce-bb2d-2a57278f704c response_code = 200 uri = /vpc-routes
22332025-01-30T20:22:01.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22342025-01-30T20:22:01.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38646 req_id = 47ee64de-9577-4f54-bc45-153e55fc82d5 response_code = 204 uri = /eip-gateways
22352025-01-30T20:22:01.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38646 req_id = 2113b64b-61a3-45c6-9094-fbca596196e2 response_code = 204 uri = /vpc-routes
22362025-01-30T20:22:01.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42332
22372025-01-30T20:22:01.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42332 req_id = a3b3c4d9-8dab-4160-854a-c5197bff22db response_code = 200 uri = /v2p
22382025-01-30T20:22:01.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61748
22392025-01-30T20:22:01.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22402025-01-30T20:22:01.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22412025-01-30T20:22:01.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61748 req_id = 71bc5b61-2cef-41cf-88d5-e2682a8415fc response_code = 204 uri = /switch-ports
22422025-01-30T20:22:01.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36409
22432025-01-30T20:22:01.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36409 req_id = a2b54de7-42b2-4f3b-8992-7b2683510c86 response_code = 200 uri = /vpc-routes
22442025-01-30T20:22:01.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61748 req_id = 39740c05-5ca4-4105-abe1-7dc7aacebcf7 response_code = 200 uri = /network-bootstore-config
22452025-01-30T20:22:01.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46169
22462025-01-30T20:22:01.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22472025-01-30T20:22:01.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22482025-01-30T20:22:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46169 req_id = e7ca8ca7-3473-4696-947e-a552c053d40d response_code = 204 uri = /switch-ports
22492025-01-30T20:22:01.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45905
22502025-01-30T20:22:01.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22512025-01-30T20:22:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36409 req_id = 25c12744-2d69-4547-9820-eab8306eb083 response_code = 204 uri = /eip-gateways
22522025-01-30T20:22:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46169 req_id = 0139a54d-573f-4c27-94b3-01d6450d561f response_code = 200 uri = /network-bootstore-config
22532025-01-30T20:22:01.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45905 req_id = 074f4986-f406-472d-8bac-048316dfcb07 response_code = 200 uri = /v2p
22542025-01-30T20:22:01.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36409 req_id = 51df8e00-4d9b-4e6e-bef4-1b6304d3aa26 response_code = 204 uri = /vpc-routes
22552025-01-30T20:22:01.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38000
22562025-01-30T20:22:01.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38000 req_id = ef87ac24-0fba-49bb-be27-baffecdab616 response_code = 200 uri = /v2p
22572025-01-30T20:22:01.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49692
22582025-01-30T20:22:01.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49692 req_id = fc1e7787-9808-404e-9bba-43db80e15dea response_code = 200 uri = /vpc-routes
22592025-01-30T20:22:01.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59896
22602025-01-30T20:22:01.729ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22612025-01-30T20:22:01.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22622025-01-30T20:22:01.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59896 req_id = b3cc0c80-3113-4806-98d1-c72784b4784f response_code = 204 uri = /switch-ports
22632025-01-30T20:22:01.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22642025-01-30T20:22:01.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49692 req_id = 3704066d-8a51-43eb-9eed-e9835618dd0f response_code = 204 uri = /eip-gateways
22652025-01-30T20:22:01.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59896 req_id = 1056b7ca-a7a1-46fd-9a60-4acce6958887 response_code = 200 uri = /network-bootstore-config
22662025-01-30T20:22:01.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49692 req_id = 752f8920-3350-4ce5-9730-9f7463f20228 response_code = 204 uri = /vpc-routes
22672025-01-30T20:22:13.138ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22682025-01-30T20:22:13.138ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22692025-01-30T20:22:13.181ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3084, tv_nsec: 390899984 } time_to_next_cleanup = 599.999995799s
22702025-01-30T20:22:15.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52986
22712025-01-30T20:22:15.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52986 req_id = ec3ebc01-68e5-4ac8-95d9-aed7b2d2d649 response_code = 200 uri = /baseboard
22722025-01-30T20:22:17.463ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13282 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 4d6a2b90-e379-432a-ab41-71c285c5e363 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
22732025-01-30T20:22:26.831ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22742025-01-30T20:22:31.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52895
22752025-01-30T20:22:31.030ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22762025-01-30T20:22:31.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52895 req_id = 65d18858-1257-4cb7-9b72-97c7ef5f67f5 response_code = 200 uri = /artifacts
22772025-01-30T20:22:31.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53166
22782025-01-30T20:22:31.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53166 req_id = e96b9543-ae3d-4935-9f43-658d75abe6d3 response_code = 200 uri = /v2p
22792025-01-30T20:22:31.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38489
22802025-01-30T20:22:31.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38489 req_id = 5ce43152-7880-46ce-b6ad-3af6adf92356 response_code = 200 uri = /vpc-routes
22812025-01-30T20:22:31.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22822025-01-30T20:22:31.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38489 req_id = ab769c76-b917-44c6-8100-b724d7f885b3 response_code = 204 uri = /eip-gateways
22832025-01-30T20:22:31.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38489 req_id = 37b51b08-a5e5-4ff4-8a92-547639b64e6c response_code = 204 uri = /vpc-routes
22842025-01-30T20:22:31.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38475
22852025-01-30T20:22:31.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
22862025-01-30T20:22:31.492ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
22872025-01-30T20:22:31.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38475 req_id = 55c6fd29-4d95-4752-bb8a-eefcae5dbba8 response_code = 204 uri = /switch-ports
22882025-01-30T20:22:31.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46047
22892025-01-30T20:22:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46047 req_id = 97279f65-dc80-4bde-a7ea-d9bcb7a1ebc0 response_code = 200 uri = /vpc-routes
22902025-01-30T20:22:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38475 req_id = e4047b92-b106-4bd5-86e0-7a90d0b41e97 response_code = 200 uri = /network-bootstore-config
22912025-01-30T20:22:31.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
22922025-01-30T20:22:31.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46047 req_id = d2d919e3-bad3-4189-a9b3-d53e5145c1cf response_code = 204 uri = /eip-gateways
22932025-01-30T20:22:31.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46047 req_id = 65c6cbbf-829b-4d09-bb72-dfc1b3a06ea7 response_code = 204 uri = /vpc-routes
22942025-01-30T20:22:31.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43926
22952025-01-30T20:22:31.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22962025-01-30T20:22:31.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43926 req_id = 5f623c0f-917c-4821-94c7-3a34d2044c9a response_code = 200 uri = /artifacts
22972025-01-30T20:22:31.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62226
22982025-01-30T20:22:31.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62226 req_id = 9237ca1f-ff01-483e-8b37-e869931793b2 response_code = 200 uri = /vpc-routes
22992025-01-30T20:22:31.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53912
23002025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23012025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23022025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23032025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23042025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23052025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23062025-01-30T20:22:31.691ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23072025-01-30T20:22:31.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53912 req_id = 1e9796d2-e60c-4c32-b00d-61ac5244c399 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23082025-01-30T20:22:31.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52713
23092025-01-30T20:22:31.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23102025-01-30T20:22:31.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23112025-01-30T20:22:31.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52713 req_id = d6ebab07-42db-4690-8273-c4f5272b3f94 response_code = 204 uri = /switch-ports
23122025-01-30T20:22:31.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57408
23132025-01-30T20:22:31.842ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
23142025-01-30T20:22:31.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48012
23152025-01-30T20:22:31.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62226 req_id = ec0a0679-716b-45df-85f5-46a48955475c response_code = 204 uri = /eip-gateways
23162025-01-30T20:22:31.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23172025-01-30T20:22:31.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52713 req_id = ca804dad-335d-426d-8bf6-aa824ad7cca6 response_code = 200 uri = /network-bootstore-config
23182025-01-30T20:22:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57408 req_id = e0bc13ed-163a-47f2-9cfa-07f134facbc1 response_code = 200 uri = /artifacts
23192025-01-30T20:22:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48012 req_id = 17e65392-8463-4269-87ee-2711c9b8b0c3 response_code = 200 uri = /v2p
23202025-01-30T20:22:31.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49983
23212025-01-30T20:22:31.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49983 req_id = d0decf0f-a828-4bf6-ba5b-9ff5d0ee60e0 response_code = 200 uri = /v2p
23222025-01-30T20:22:31.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62226 req_id = 64c4d396-cf8e-4418-a822-faf7775cbb02 response_code = 204 uri = /vpc-routes
23232025-01-30T20:22:31.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46880
23242025-01-30T20:22:31.909ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23252025-01-30T20:22:31.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23262025-01-30T20:22:32.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46880 req_id = 9465ab4b-1ca0-492f-9ad8-64b5bbade142 response_code = 204 uri = /switch-ports
23272025-01-30T20:22:32.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54285
23282025-01-30T20:22:32.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44553
23292025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23302025-01-30T20:22:32.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46880 req_id = c4a750ad-0011-4f9b-92da-4111b18d8dc9 response_code = 200 uri = /network-bootstore-config
23312025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23322025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23332025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23342025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23352025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23362025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23372025-01-30T20:22:32.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 447 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44553 req_id = 38982888-f130-467e-b2d3-89b38fcd4c0a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23382025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23392025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23402025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23412025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23422025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23432025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23442025-01-30T20:22:32.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23452025-01-30T20:22:32.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54285 req_id = 1bec24c0-b619-4665-9fc3-22e3ad74495f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23462025-01-30T20:22:45.730ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62051
23472025-01-30T20:22:45.730ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62051 req_id = 29b51607-7c4a-4437-9562-8eb9b0b0d924 response_code = 200 uri = /baseboard
23482025-01-30T20:22:47.455ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6425 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 10f98091-b56a-4056-b8b6-bf619788696e response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
23492025-01-30T20:23:01.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64818
23502025-01-30T20:23:01.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64818 req_id = 0a078ff9-cd8c-44fa-b017-4f843b09c800 response_code = 200 uri = /vpc-routes
23512025-01-30T20:23:01.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
23522025-01-30T20:23:01.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64818 req_id = de1859b6-061b-4f82-926b-bfbf4d0811fe response_code = 204 uri = /eip-gateways
23532025-01-30T20:23:01.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64818 req_id = baaa80e0-92c6-4db0-8725-4ff512fc2d3f response_code = 204 uri = /vpc-routes
23542025-01-30T20:23:01.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50515
23552025-01-30T20:23:01.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50515 req_id = 8b8e3f7d-891e-476b-9d77-639de7fdfecb response_code = 200 uri = /v2p
23562025-01-30T20:23:01.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51063
23572025-01-30T20:23:01.085ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23582025-01-30T20:23:01.134ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23592025-01-30T20:23:01.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138266 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51063 req_id = 163a79fb-f293-4c9e-b64b-7904d3db6d94 response_code = 204 uri = /switch-ports
23602025-01-30T20:23:01.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51063 req_id = 754163aa-e43e-403c-9a6d-1389a4e1ffe9 response_code = 200 uri = /network-bootstore-config
23612025-01-30T20:23:01.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57438
23622025-01-30T20:23:01.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57438 req_id = 3b570560-ba92-4704-a0c0-06c00a578c11 response_code = 200 uri = /vpc-routes
23632025-01-30T20:23:01.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
23642025-01-30T20:23:01.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57438 req_id = fafeb172-a0a1-4224-9b00-ccdf5b2709b0 response_code = 204 uri = /eip-gateways
23652025-01-30T20:23:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57438 req_id = 672c09e5-6d03-4542-84e2-8fa9487306d7 response_code = 204 uri = /vpc-routes
23662025-01-30T20:23:01.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56399
23672025-01-30T20:23:01.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56399 req_id = 6fd0ba73-6bfd-480c-8893-af57ecd56910 response_code = 200 uri = /v2p
23682025-01-30T20:23:01.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34389
23692025-01-30T20:23:01.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23702025-01-30T20:23:01.486ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23712025-01-30T20:23:01.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34389 req_id = 4d4c27cc-c332-4215-b4d2-5ad4fd642348 response_code = 204 uri = /switch-ports
23722025-01-30T20:23:01.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34389 req_id = 41a156fd-8489-49ba-bcc8-e1db5e9d042c response_code = 200 uri = /network-bootstore-config
23732025-01-30T20:23:01.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58806
23742025-01-30T20:23:01.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58806 req_id = a18bd77d-b985-46a3-b365-83eea8250e19 response_code = 200 uri = /vpc-routes
23752025-01-30T20:23:01.572ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
23762025-01-30T20:23:01.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58806 req_id = bce1548a-9491-4287-b423-7b7e2a2061f6 response_code = 204 uri = /eip-gateways
23772025-01-30T20:23:01.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58806 req_id = bf8bc7c3-b1a2-4ba4-8433-0ff1e0af8567 response_code = 204 uri = /vpc-routes
23782025-01-30T20:23:01.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60135
23792025-01-30T20:23:01.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60135 req_id = a22deb93-9cc1-489e-996b-d78ef871a9f3 response_code = 200 uri = /v2p
23802025-01-30T20:23:01.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39190
23812025-01-30T20:23:01.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23822025-01-30T20:23:01.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23832025-01-30T20:23:01.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39190 req_id = 1b1ec102-c43b-4c2b-b50b-5638d8f7ce61 response_code = 204 uri = /switch-ports
23842025-01-30T20:23:01.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39190 req_id = bcf9a4f0-a474-496a-9afd-3c56663a65fa response_code = 200 uri = /network-bootstore-config
23852025-01-30T20:23:15.762ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48149
23862025-01-30T20:23:15.762ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48149 req_id = 2124deed-8abe-47fd-9dac-ecf136a92097 response_code = 200 uri = /baseboard
23872025-01-30T20:23:17.455ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5883 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 66113804-73fa-4588-80ca-0ba06f5041aa response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
23882025-01-30T20:23:31.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43928
23892025-01-30T20:23:31.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43928 req_id = 570e180d-6982-4e3d-a864-d3e41e3e15b6 response_code = 200 uri = /vpc-routes
23902025-01-30T20:23:31.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
23912025-01-30T20:23:31.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43928 req_id = 82ac8dcd-77ad-4190-aabf-f4a6d32a8dae response_code = 204 uri = /eip-gateways
23922025-01-30T20:23:31.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43928 req_id = 6ec0f57e-9153-49fe-9417-a4431a68b87f response_code = 204 uri = /vpc-routes
23932025-01-30T20:23:31.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38289
23942025-01-30T20:23:31.276ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
23952025-01-30T20:23:31.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
23962025-01-30T20:23:31.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130252 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38289 req_id = 069ad8ed-605e-4911-a701-b9f5381f1c7b response_code = 204 uri = /switch-ports
23972025-01-30T20:23:31.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43152
23982025-01-30T20:23:31.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43152 req_id = a4ed64a8-fb22-420a-8a67-38c90b96862c response_code = 200 uri = /v2p
23992025-01-30T20:23:31.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38289 req_id = 322a0b64-fc48-4089-bf88-5cc1fbc2a4c5 response_code = 200 uri = /network-bootstore-config
24002025-01-30T20:23:31.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65437
24012025-01-30T20:23:31.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65437 req_id = 6fd92f0b-9715-48fa-a260-bd8bef78a2c9 response_code = 200 uri = /vpc-routes
24022025-01-30T20:23:31.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24032025-01-30T20:23:31.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65437 req_id = 1e8af4d7-d947-48f7-a721-005b42c41331 response_code = 204 uri = /eip-gateways
24042025-01-30T20:23:31.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65437 req_id = 8e79e62b-c903-4bf8-937a-df4f5944603d response_code = 204 uri = /vpc-routes
24052025-01-30T20:23:31.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44872
24062025-01-30T20:23:31.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44872 req_id = 15f22ab1-659a-41b2-a204-ad42839d6ca8 response_code = 200 uri = /vpc-routes
24072025-01-30T20:23:31.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24082025-01-30T20:23:31.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44872 req_id = f23bc32c-e0d2-4028-9c66-afabc4247b15 response_code = 204 uri = /eip-gateways
24092025-01-30T20:23:31.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50239
24102025-01-30T20:23:31.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50239 req_id = 3b4a5c96-c4b7-4625-b3ec-217af456a20b response_code = 200 uri = /v2p
24112025-01-30T20:23:31.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44872 req_id = d8f4a305-3b61-454b-82c2-d828c1b9408e response_code = 204 uri = /vpc-routes
24122025-01-30T20:23:31.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49247
24132025-01-30T20:23:31.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24142025-01-30T20:23:31.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24152025-01-30T20:23:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49247 req_id = d67187ee-9c2b-493c-a830-3499781a36e2 response_code = 204 uri = /switch-ports
24162025-01-30T20:23:31.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63456
24172025-01-30T20:23:31.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46359
24182025-01-30T20:23:31.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24192025-01-30T20:23:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49247 req_id = a2526f59-0efc-47ad-9d85-b82e29ed005a response_code = 200 uri = /network-bootstore-config
24202025-01-30T20:23:31.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63456 req_id = 4974674f-4526-48ce-aff6-9c3659352a00 response_code = 200 uri = /v2p
24212025-01-30T20:23:31.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24222025-01-30T20:23:31.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46359 req_id = 4d61dfda-fc92-4a98-90a2-a31d8629ffea response_code = 204 uri = /switch-ports
24232025-01-30T20:23:31.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46359 req_id = 4bf0ea5f-b0cc-4e2a-b00c-efb3b512fd04 response_code = 200 uri = /network-bootstore-config
24242025-01-30T20:23:45.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43345
24252025-01-30T20:23:45.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43345 req_id = 91dc013c-c07b-4bbe-af46-99bff52d2fea response_code = 200 uri = /baseboard
24262025-01-30T20:23:47.457ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8263 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = c56e35ba-9a93-4f5b-a0fd-4c79c8a7cbac response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
24272025-01-30T20:24:01.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49981
24282025-01-30T20:24:01.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49981 req_id = 5122bcd8-fd15-45f6-98a2-6b9609995a3a response_code = 200 uri = /vpc-routes
24292025-01-30T20:24:01.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24302025-01-30T20:24:01.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49981 req_id = b7aaa6a2-3a38-464e-a14a-262f7ac1d0cf response_code = 204 uri = /eip-gateways
24312025-01-30T20:24:01.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49981 req_id = 9902c015-fbc4-47c2-8a3e-8d25266d1242 response_code = 204 uri = /vpc-routes
24322025-01-30T20:24:01.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50488
24332025-01-30T20:24:01.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50488 req_id = 73fed93e-918d-4e1e-a2c5-7bce9ecccd4a response_code = 200 uri = /v2p
24342025-01-30T20:24:01.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62886
24352025-01-30T20:24:01.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24362025-01-30T20:24:01.321ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24372025-01-30T20:24:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62886 req_id = e2a90115-1f3c-41bf-850b-d3bf0ae8bb04 response_code = 204 uri = /switch-ports
24382025-01-30T20:24:01.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50097
24392025-01-30T20:24:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50097 req_id = 62ba8bfd-22b4-41b9-8f73-316b992a4413 response_code = 200 uri = /vpc-routes
24402025-01-30T20:24:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62886 req_id = 82384366-c631-4610-b6cf-1db502e925b5 response_code = 200 uri = /network-bootstore-config
24412025-01-30T20:24:01.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43564
24422025-01-30T20:24:01.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43564 req_id = 345ddaa1-c38d-4f69-bf1c-6f40d8c138bd response_code = 200 uri = /vpc-routes
24432025-01-30T20:24:01.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24442025-01-30T20:24:01.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43564 req_id = b2c223c8-1fce-48de-9fd9-38a16cf82322 response_code = 204 uri = /eip-gateways
24452025-01-30T20:24:01.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43564 req_id = b645d17b-bbcf-430b-9c28-5582caec6055 response_code = 204 uri = /vpc-routes
24462025-01-30T20:24:01.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49935
24472025-01-30T20:24:01.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49935 req_id = c8d24003-e805-4e80-901e-db6955c464a9 response_code = 200 uri = /v2p
24482025-01-30T20:24:01.451ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24492025-01-30T20:24:01.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50097 req_id = 57815130-ac80-415d-8282-b2f68d2a45de response_code = 204 uri = /eip-gateways
24502025-01-30T20:24:01.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50097 req_id = ed4a142a-3617-4aec-9b28-00cd36d47008 response_code = 204 uri = /vpc-routes
24512025-01-30T20:24:01.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65188
24522025-01-30T20:24:01.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24532025-01-30T20:24:01.528ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24542025-01-30T20:24:01.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94580 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65188 req_id = 4510b70b-68da-49a8-9cee-68f7dcbaf139 response_code = 204 uri = /switch-ports
24552025-01-30T20:24:01.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61040
24562025-01-30T20:24:01.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59642
24572025-01-30T20:24:01.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65188 req_id = 180b1dd7-5ae8-4b7f-861d-60211d585dd3 response_code = 200 uri = /network-bootstore-config
24582025-01-30T20:24:01.585ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24592025-01-30T20:24:01.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59642 req_id = 8a5c57ab-805f-4aeb-8fd9-52f3bea87a98 response_code = 200 uri = /v2p
24602025-01-30T20:24:01.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24612025-01-30T20:24:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86800 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61040 req_id = 3f185a10-ae97-4145-8d39-a7964c581fa9 response_code = 204 uri = /switch-ports
24622025-01-30T20:24:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61040 req_id = f39b1ed6-5d37-460e-b036-7ef4f732c62f response_code = 200 uri = /network-bootstore-config
24632025-01-30T20:24:15.828ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54621
24642025-01-30T20:24:15.828ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54621 req_id = b920ab5c-c1b6-4e63-b888-e7f3a9fc5720 response_code = 200 uri = /baseboard
24652025-01-30T20:24:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6892 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 7b7e0eac-06d5-446b-839a-f826625c7d03 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
24662025-01-30T20:24:31.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43633
24672025-01-30T20:24:31.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43633 req_id = b88401f0-1809-4861-bd13-7a6d2bbb1ad0 response_code = 200 uri = /vpc-routes
24682025-01-30T20:24:31.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24692025-01-30T20:24:31.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43633 req_id = a258cadf-83bb-4f37-bcb6-42fa2d899bb8 response_code = 204 uri = /eip-gateways
24702025-01-30T20:24:31.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43633 req_id = 820890ab-52d3-44f3-abcb-10913e0a9250 response_code = 204 uri = /vpc-routes
24712025-01-30T20:24:31.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52901
24722025-01-30T20:24:31.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52901 req_id = 0978b92e-aff5-469c-a6c9-5a6baeac0cf8 response_code = 200 uri = /v2p
24732025-01-30T20:24:31.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45374
24742025-01-30T20:24:31.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24752025-01-30T20:24:31.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24762025-01-30T20:24:31.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45374 req_id = 71a4065b-1d26-4cf1-a4b9-591da9cc8e79 response_code = 204 uri = /switch-ports
24772025-01-30T20:24:31.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60974
24782025-01-30T20:24:31.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47222
24792025-01-30T20:24:31.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45374 req_id = 2c633bfd-6959-4e45-9eb2-0dcce62ecabf response_code = 200 uri = /network-bootstore-config
24802025-01-30T20:24:31.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60974 req_id = b839cecb-d2bb-4aa7-8db6-ab5691ae7151 response_code = 200 uri = /vpc-routes
24812025-01-30T20:24:31.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47222 req_id = 667e3442-40b4-47a2-aeb0-a15df8745d3a response_code = 200 uri = /v2p
24822025-01-30T20:24:31.573ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24832025-01-30T20:24:31.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60974 req_id = 23055afc-529b-4cd2-9cf3-717c910917e6 response_code = 204 uri = /eip-gateways
24842025-01-30T20:24:31.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60974 req_id = 32bb0c05-146f-4391-a371-b900d60d440e response_code = 204 uri = /vpc-routes
24852025-01-30T20:24:31.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40527
24862025-01-30T20:24:31.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40527 req_id = a660c377-f079-4ff2-b92e-cfe6c2a4c067 response_code = 200 uri = /vpc-routes
24872025-01-30T20:24:31.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
24882025-01-30T20:24:31.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40527 req_id = 88997d06-f40d-4935-976a-1de1031534ae response_code = 204 uri = /eip-gateways
24892025-01-30T20:24:31.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40527 req_id = 11c9d901-f556-4253-9624-0ec83b0a841a response_code = 204 uri = /vpc-routes
24902025-01-30T20:24:31.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62192
24912025-01-30T20:24:31.713ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24922025-01-30T20:24:31.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
24932025-01-30T20:24:31.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98013 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62192 req_id = b177fca3-2568-438e-ab69-cbab41e6933d response_code = 204 uri = /switch-ports
24942025-01-30T20:24:31.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43729
24952025-01-30T20:24:31.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63353
24962025-01-30T20:24:31.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43729 req_id = 620cfd46-dbb6-4a30-b982-d3366b223165 response_code = 200 uri = /v2p
24972025-01-30T20:24:31.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62192 req_id = 6d072343-9796-4df5-ac10-39bcda1059c1 response_code = 200 uri = /network-bootstore-config
24982025-01-30T20:24:31.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
24992025-01-30T20:24:31.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25002025-01-30T20:24:31.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95689 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63353 req_id = d6bcfbf7-6ec7-4dae-9edc-0f903abd00e9 response_code = 204 uri = /switch-ports
25012025-01-30T20:24:31.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63353 req_id = 6fe34087-2e3b-45e4-9fed-ec946b59c8eb response_code = 200 uri = /network-bootstore-config
25022025-01-30T20:24:45.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34542
25032025-01-30T20:24:45.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34542 req_id = 19775450-ea0e-4cba-b8f6-6a159ccf5411 response_code = 200 uri = /baseboard
25042025-01-30T20:24:47.457ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7728 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = f5ae7cc3-2b0e-4b03-b5a3-a3d5332477a5 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
25052025-01-30T20:25:01.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51896
25062025-01-30T20:25:01.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51896 req_id = 4e614e0c-0161-44cb-aa4f-5611f58e6d8d response_code = 200 uri = /vpc-routes
25072025-01-30T20:25:01.068ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25082025-01-30T20:25:01.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51896 req_id = ab0c17a5-f1f0-4e57-bde9-75dac8feef4a response_code = 204 uri = /eip-gateways
25092025-01-30T20:25:01.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51896 req_id = 15f69813-2e91-45c5-9eab-61b2670b1336 response_code = 204 uri = /vpc-routes
25102025-01-30T20:25:01.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42315
25112025-01-30T20:25:01.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42315 req_id = 2b3a8a34-835a-424a-8b6f-853b783e0524 response_code = 200 uri = /v2p
25122025-01-30T20:25:01.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54910
25132025-01-30T20:25:01.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25142025-01-30T20:25:01.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25152025-01-30T20:25:01.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54910 req_id = c94b772a-c6d5-4e47-9408-6ebf9cedc43f response_code = 204 uri = /switch-ports
25162025-01-30T20:25:01.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54910 req_id = 9ce69889-8560-4e7c-982b-570945a354ae response_code = 200 uri = /network-bootstore-config
25172025-01-30T20:25:01.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46774
25182025-01-30T20:25:01.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46774 req_id = 92b4d34d-b6e1-45b3-9ca7-0884b5559d26 response_code = 200 uri = /vpc-routes
25192025-01-30T20:25:01.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25202025-01-30T20:25:01.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46774 req_id = b7fccf9d-df20-4f01-9b2a-55a14677e6db response_code = 204 uri = /eip-gateways
25212025-01-30T20:25:01.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46774 req_id = 6688cb93-717c-440a-95a9-dd0afb4dd220 response_code = 204 uri = /vpc-routes
25222025-01-30T20:25:01.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52793
25232025-01-30T20:25:01.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52793 req_id = 074b1deb-5f25-4779-8e43-ac23c21a594e response_code = 200 uri = /v2p
25242025-01-30T20:25:01.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53224
25252025-01-30T20:25:01.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53224 req_id = 7ecda10a-9ccc-42a6-a348-9785f086c644 response_code = 200 uri = /vpc-routes
25262025-01-30T20:25:01.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54904
25272025-01-30T20:25:01.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25282025-01-30T20:25:01.552ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25292025-01-30T20:25:01.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102011 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54904 req_id = 599cebfb-0994-4bf7-8082-2bcbf035a88a response_code = 204 uri = /switch-ports
25302025-01-30T20:25:01.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61291
25312025-01-30T20:25:01.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25322025-01-30T20:25:01.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55844
25332025-01-30T20:25:01.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53224 req_id = 57ff7bd3-ea7f-45fb-89c9-4e334f326699 response_code = 204 uri = /eip-gateways
25342025-01-30T20:25:01.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54904 req_id = 49b9c7d1-1706-420f-9c5a-08f2762f5d3a response_code = 200 uri = /network-bootstore-config
25352025-01-30T20:25:01.613ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25362025-01-30T20:25:01.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55844 req_id = 415e29c3-0cf1-40ea-816d-b86ac4b9a957 response_code = 200 uri = /v2p
25372025-01-30T20:25:01.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53224 req_id = 9cc37ad1-6954-49f2-8079-6e0bc1557359 response_code = 204 uri = /vpc-routes
25382025-01-30T20:25:01.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25392025-01-30T20:25:01.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61291 req_id = a511b115-d9d4-41e7-8f98-48805147354d response_code = 204 uri = /switch-ports
25402025-01-30T20:25:01.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61291 req_id = 634d6e77-c035-4a8f-a2cc-e4d1c452307b response_code = 200 uri = /network-bootstore-config
25412025-01-30T20:25:15.894ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45744
25422025-01-30T20:25:15.894ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45744 req_id = 0003b100-8b87-4078-adf2-139faf4204af response_code = 200 uri = /baseboard
25432025-01-30T20:25:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6551 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = a3e8a577-674c-4dd4-8278-63e256148d83 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
25442025-01-30T20:25:31.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33190
25452025-01-30T20:25:31.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33190 req_id = f149e133-c5aa-423e-9f40-081214f3b095 response_code = 200 uri = /v2p
25462025-01-30T20:25:31.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56103
25472025-01-30T20:25:31.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56103 req_id = 7faae2c1-aa41-48ee-b411-3dd3e278cd52 response_code = 200 uri = /vpc-routes
25482025-01-30T20:25:31.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25492025-01-30T20:25:31.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56103 req_id = 4eccaf4f-e633-4030-95ac-789e8d5f4e88 response_code = 204 uri = /eip-gateways
25502025-01-30T20:25:31.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56103 req_id = 764d4166-0b76-4c1a-bdee-8fcf584bfafe response_code = 204 uri = /vpc-routes
25512025-01-30T20:25:31.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33504
25522025-01-30T20:25:31.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25532025-01-30T20:25:31.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25542025-01-30T20:25:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134075 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33504 req_id = 6dd46740-fbb8-4c4a-a66b-26a58f70e416 response_code = 204 uri = /switch-ports
25552025-01-30T20:25:31.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37118
25562025-01-30T20:25:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37118 req_id = efea5b5a-3b41-4710-ae10-69a2cddd6471 response_code = 200 uri = /vpc-routes
25572025-01-30T20:25:31.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33504 req_id = 5c26214d-109e-48d6-9975-ffef3aa344ff response_code = 200 uri = /network-bootstore-config
25582025-01-30T20:25:31.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49261
25592025-01-30T20:25:31.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49261 req_id = 7ad45c56-387f-4ccb-893e-c9907fe92fb7 response_code = 200 uri = /vpc-routes
25602025-01-30T20:25:31.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25612025-01-30T20:25:31.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37118 req_id = 16663655-f8d0-4d52-be34-7049745dc7dd response_code = 204 uri = /eip-gateways
25622025-01-30T20:25:31.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25632025-01-30T20:25:31.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49261 req_id = 3ca87abc-7e92-4e53-905a-4e41bd071d88 response_code = 204 uri = /eip-gateways
25642025-01-30T20:25:31.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49261 req_id = 8765c9ba-a400-4a0a-854c-d1802d244ddb response_code = 204 uri = /vpc-routes
25652025-01-30T20:25:31.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50070
25662025-01-30T20:25:31.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50070 req_id = 16cd0a99-5891-4465-b188-08e739c5c831 response_code = 200 uri = /v2p
25672025-01-30T20:25:31.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37118 req_id = ca96442f-74bf-4a0a-8f50-7f08e52ab175 response_code = 204 uri = /vpc-routes
25682025-01-30T20:25:31.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52329
25692025-01-30T20:25:31.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52329 req_id = eaac7ce9-fb10-4e5e-b5dc-ab3743409f22 response_code = 200 uri = /v2p
25702025-01-30T20:25:31.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52424
25712025-01-30T20:25:31.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25722025-01-30T20:25:31.791ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25732025-01-30T20:25:31.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52424 req_id = 7203d1a3-d46a-49c8-8449-a50e49a8284f response_code = 204 uri = /switch-ports
25742025-01-30T20:25:31.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42711
25752025-01-30T20:25:31.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25762025-01-30T20:25:31.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25772025-01-30T20:25:31.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42711 req_id = 934227fe-9702-43f3-9670-af9dbe58c57a response_code = 204 uri = /switch-ports
25782025-01-30T20:25:31.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42711 req_id = d1cd52d1-61a8-4f3a-9e8f-81497ea5ea47 response_code = 200 uri = /network-bootstore-config
25792025-01-30T20:25:31.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52424 req_id = 8133f9ca-a261-43dc-beca-9407062cdcfd response_code = 200 uri = /network-bootstore-config
25802025-01-30T20:25:45.927ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53253
25812025-01-30T20:25:45.927ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53253 req_id = b378ed42-fe16-467d-80ec-fa635c9920f6 response_code = 200 uri = /baseboard
25822025-01-30T20:25:47.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6503 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 66d82460-4af3-426f-a115-5faa42ec2f9c response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
25832025-01-30T20:26:01.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46837
25842025-01-30T20:26:01.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46837 req_id = 53840339-39b7-4316-9c90-df757aa471f3 response_code = 200 uri = /vpc-routes
25852025-01-30T20:26:01.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
25862025-01-30T20:26:01.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46837 req_id = 42bd36d2-df1f-4fed-b715-86300696d6f5 response_code = 204 uri = /eip-gateways
25872025-01-30T20:26:01.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46837 req_id = 58bbb114-37fb-41ff-a065-202047b3c340 response_code = 204 uri = /vpc-routes
25882025-01-30T20:26:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60802
25892025-01-30T20:26:01.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
25902025-01-30T20:26:01.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
25912025-01-30T20:26:01.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131818 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60802 req_id = 7c6f23d6-b076-4f91-9fa8-07e314160f1b response_code = 204 uri = /switch-ports
25922025-01-30T20:26:01.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33209
25932025-01-30T20:26:01.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33209 req_id = 6324e20d-97ac-45ff-bae2-1258d639f4e1 response_code = 200 uri = /v2p
25942025-01-30T20:26:01.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60802 req_id = ade8ab24-6cff-45cf-af75-a26bf6985e23 response_code = 200 uri = /network-bootstore-config
25952025-01-30T20:26:01.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63554
25962025-01-30T20:26:01.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63554 req_id = 75872694-2b27-40b6-ae51-101a66154dec response_code = 200 uri = /v2p
25972025-01-30T20:26:01.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44697
25982025-01-30T20:26:01.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44697 req_id = 92a923ca-ee93-47c8-a7cf-f8bc7038af07 response_code = 200 uri = /vpc-routes
25992025-01-30T20:26:01.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57238
26002025-01-30T20:26:01.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57238 req_id = 544717a9-2c5c-456c-a25d-3cef968d64b0 response_code = 200 uri = /vpc-routes
26012025-01-30T20:26:01.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26022025-01-30T20:26:01.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44697 req_id = 8ae88aa2-8415-45ad-a205-705ff4af622e response_code = 204 uri = /eip-gateways
26032025-01-30T20:26:01.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44697 req_id = e7e1c729-a838-4098-9ca6-4f716fcdb17a response_code = 204 uri = /vpc-routes
26042025-01-30T20:26:01.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64380
26052025-01-30T20:26:01.500ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26062025-01-30T20:26:01.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26072025-01-30T20:26:01.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64380 req_id = 507800ab-f4e2-43f9-b7dd-6c98b9f7d9d2 response_code = 204 uri = /switch-ports
26082025-01-30T20:26:01.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55792
26092025-01-30T20:26:01.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26102025-01-30T20:26:01.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57238 req_id = e359d39e-4cb2-425d-8de2-a4b21af5e2fd response_code = 204 uri = /eip-gateways
26112025-01-30T20:26:01.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26122025-01-30T20:26:01.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64380 req_id = 92a8ed57-fa57-4095-86b0-4c9c52b0f064 response_code = 200 uri = /network-bootstore-config
26132025-01-30T20:26:01.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57238 req_id = f36a4e68-733f-4588-b0c2-e4278a8189e5 response_code = 204 uri = /vpc-routes
26142025-01-30T20:26:01.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26152025-01-30T20:26:01.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59722
26162025-01-30T20:26:01.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59722 req_id = bbf7e35d-d7e9-42c3-a14a-14a14f992d99 response_code = 200 uri = /v2p
26172025-01-30T20:26:01.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55792 req_id = 98e3678d-5fc8-424b-92dc-63092eb76854 response_code = 204 uri = /switch-ports
26182025-01-30T20:26:01.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55792 req_id = 899eabd8-fc74-49c8-b120-ae0bedc8a813 response_code = 200 uri = /network-bootstore-config
26192025-01-30T20:26:15.961ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62002
26202025-01-30T20:26:15.961ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62002 req_id = c8ac90d5-465c-4387-856c-8e91c4a6672d response_code = 200 uri = /baseboard
26212025-01-30T20:26:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6959 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 0802cd98-2b4b-413f-9683-98552d3e2949 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
26222025-01-30T20:26:31.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51873
26232025-01-30T20:26:31.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51873 req_id = 57684573-c621-414a-bc4c-4e9938ebfca0 response_code = 200 uri = /vpc-routes
26242025-01-30T20:26:31.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26252025-01-30T20:26:31.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51873 req_id = 3d01fd37-e34d-49a0-999a-1481fe5b023a response_code = 204 uri = /eip-gateways
26262025-01-30T20:26:31.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36434
26272025-01-30T20:26:31.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36434 req_id = da1a220a-677a-4d21-a12d-dc63ca106b90 response_code = 200 uri = /v2p
26282025-01-30T20:26:31.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51873 req_id = 7fdc6956-9bdf-404d-baed-11e8511b58ab response_code = 204 uri = /vpc-routes
26292025-01-30T20:26:31.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37916
26302025-01-30T20:26:31.433ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26312025-01-30T20:26:31.483ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26322025-01-30T20:26:31.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37916 req_id = fd148333-e293-40c9-bc85-1d504596aa0d response_code = 204 uri = /switch-ports
26332025-01-30T20:26:31.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54697
26342025-01-30T20:26:31.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37375
26352025-01-30T20:26:31.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54697 req_id = 539f78d4-c203-4ae0-bcce-61fbcba1e45a response_code = 200 uri = /vpc-routes
26362025-01-30T20:26:31.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37375 req_id = 8420a661-7cb3-4406-9412-1860a4f33fcb response_code = 200 uri = /vpc-routes
26372025-01-30T20:26:31.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37916 req_id = e3c408d5-135a-497d-9924-27dbe6048e5d response_code = 200 uri = /network-bootstore-config
26382025-01-30T20:26:31.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26392025-01-30T20:26:31.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54697 req_id = 29a54fd9-463e-4d2e-9a7b-ead91d2dba2d response_code = 204 uri = /eip-gateways
26402025-01-30T20:26:31.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26412025-01-30T20:26:31.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37375 req_id = 47c4ce8d-aa4c-4b40-91d1-b4b70d1f0de6 response_code = 204 uri = /eip-gateways
26422025-01-30T20:26:31.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49542
26432025-01-30T20:26:31.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26442025-01-30T20:26:31.634ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26452025-01-30T20:26:31.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49542 req_id = 36cf64a1-5aa9-40de-92f0-436bbd0802cd response_code = 204 uri = /switch-ports
26462025-01-30T20:26:31.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53358
26472025-01-30T20:26:31.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37375 req_id = 0288c7d0-02f5-4b46-97fc-2d5081767d9f response_code = 204 uri = /vpc-routes
26482025-01-30T20:26:31.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49542 req_id = dc351dd2-0164-42a3-ac45-c7928c968875 response_code = 200 uri = /network-bootstore-config
26492025-01-30T20:26:31.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53358 req_id = 7f0dc03c-35b3-4b2b-b564-f83655ee71bd response_code = 200 uri = /v2p
26502025-01-30T20:26:31.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54697 req_id = d1efd820-4198-444d-a2da-28c52bf4f8cd response_code = 204 uri = /vpc-routes
26512025-01-30T20:26:31.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44153
26522025-01-30T20:26:31.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26532025-01-30T20:26:31.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26542025-01-30T20:26:31.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44153 req_id = ff199d83-c776-4d67-823e-39d13c5acd79 response_code = 204 uri = /switch-ports
26552025-01-30T20:26:31.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43422
26562025-01-30T20:26:31.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44153 req_id = 3ed09d37-0e16-4e2e-8f8c-a22f4bce591c response_code = 200 uri = /network-bootstore-config
26572025-01-30T20:26:31.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43422 req_id = 64010b86-b9d7-4920-9cc6-4175e0c88d71 response_code = 200 uri = /v2p
26582025-01-30T20:26:45.994ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40805
26592025-01-30T20:26:45.994ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40805 req_id = d0f6641b-9b4c-4e5c-9bf8-8fe1e39b05d2 response_code = 200 uri = /baseboard
26602025-01-30T20:26:47.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6783 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 0387db3c-3cf4-40e7-973e-a70ba4b07a9f response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
26612025-01-30T20:27:01.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37767
26622025-01-30T20:27:01.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37767 req_id = d802cb25-4613-4186-a573-4f018d7ea2b8 response_code = 200 uri = /vpc-routes
26632025-01-30T20:27:01.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26642025-01-30T20:27:01.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37767 req_id = 17c66c2f-76bf-4fb2-86f7-5894e0718c8e response_code = 204 uri = /eip-gateways
26652025-01-30T20:27:01.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37767 req_id = 18c5d50c-806b-4197-bd91-d37528d90833 response_code = 204 uri = /vpc-routes
26662025-01-30T20:27:01.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64573
26672025-01-30T20:27:01.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64573 req_id = 4873f748-d417-4903-b0a0-dca9235d47c0 response_code = 200 uri = /v2p
26682025-01-30T20:27:01.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62513
26692025-01-30T20:27:01.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26702025-01-30T20:27:01.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26712025-01-30T20:27:01.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62513 req_id = 7c099689-fc0f-4339-8197-dca10342420f response_code = 204 uri = /switch-ports
26722025-01-30T20:27:01.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62513 req_id = 8f6f415d-e249-4f68-9d96-e907e9e51fbe response_code = 200 uri = /network-bootstore-config
26732025-01-30T20:27:01.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58052
26742025-01-30T20:27:01.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58052 req_id = 8b3d1716-4d23-4942-9935-4425ff4f778c response_code = 200 uri = /vpc-routes
26752025-01-30T20:27:01.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26762025-01-30T20:27:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58052 req_id = 75fc55f0-a9d8-47fd-bc45-a5dc2e3dc56d response_code = 204 uri = /eip-gateways
26772025-01-30T20:27:01.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61682
26782025-01-30T20:27:01.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61682 req_id = 0be1e313-f81e-45ae-8c40-54833ee23951 response_code = 200 uri = /vpc-routes
26792025-01-30T20:27:01.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34541
26802025-01-30T20:27:01.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34541 req_id = 4bb6f876-3fed-4e50-bdc0-2306765ab6d2 response_code = 200 uri = /v2p
26812025-01-30T20:27:01.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58052 req_id = 4fd23781-84f5-40e7-be7e-7b2d09c5934d response_code = 204 uri = /vpc-routes
26822025-01-30T20:27:01.525ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
26832025-01-30T20:27:01.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61682 req_id = 12b6a5d7-20cd-48f9-a846-a7d70448e6e5 response_code = 204 uri = /eip-gateways
26842025-01-30T20:27:01.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53627
26852025-01-30T20:27:01.529ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26862025-01-30T20:27:01.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26872025-01-30T20:27:01.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 99e3a725-975c-4da8-9ed9-5046b89ba1b6 response_code = 204 uri = /switch-ports
26882025-01-30T20:27:01.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38037
26892025-01-30T20:27:01.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59447
26902025-01-30T20:27:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 5b00e408-6610-489b-9cdb-7c1122b2dabf response_code = 200 uri = /network-bootstore-config
26912025-01-30T20:27:01.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
26922025-01-30T20:27:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38037 req_id = b89a5227-1ca4-497c-8ed7-421973e517e5 response_code = 200 uri = /v2p
26932025-01-30T20:27:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 612 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61682 req_id = dfa284c7-9057-462e-ba6d-a56ca02b5168 response_code = 204 uri = /vpc-routes
26942025-01-30T20:27:01.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
26952025-01-30T20:27:01.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97518 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59447 req_id = efd010bf-dcc1-43d1-908c-38095fdaab1e response_code = 204 uri = /switch-ports
26962025-01-30T20:27:01.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59447 req_id = 6680d4a9-91d2-4005-87ce-7fdb51934751 response_code = 200 uri = /network-bootstore-config
26972025-01-30T20:27:16.028ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35407
26982025-01-30T20:27:16.028ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35407 req_id = cc98da98-9589-4efd-8d38-d69e7d68fcb8 response_code = 200 uri = /baseboard
26992025-01-30T20:27:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6855 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 7d35b72e-c955-4bc4-928f-2121dd1eed2f response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
27002025-01-30T20:27:26.832ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
27012025-01-30T20:27:31.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39243
27022025-01-30T20:27:31.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39243 req_id = f03c4316-bbaa-4487-b571-3a98258e7637 response_code = 200 uri = /vpc-routes
27032025-01-30T20:27:31.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54486
27042025-01-30T20:27:31.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27052025-01-30T20:27:31.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54486 req_id = 5725630b-010d-4f4f-ad5d-47c1415993ba response_code = 200 uri = /artifacts
27062025-01-30T20:27:31.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
27072025-01-30T20:27:31.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39243 req_id = 5e9fef64-fffa-4cc2-9b33-af0ea7c594bf response_code = 204 uri = /eip-gateways
27082025-01-30T20:27:31.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39243 req_id = 512a4d07-ea7b-4511-9ab7-a9165b11267d response_code = 204 uri = /vpc-routes
27092025-01-30T20:27:31.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45286
27102025-01-30T20:27:31.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45286 req_id = aba34554-f851-40fa-974f-be9f6898e026 response_code = 200 uri = /vpc-routes
27112025-01-30T20:27:31.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43072
27122025-01-30T20:27:31.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43072 req_id = ae890aad-07c2-4fff-aa78-b3d67de8bd02 response_code = 200 uri = /v2p
27132025-01-30T20:27:31.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50798
27142025-01-30T20:27:31.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27152025-01-30T20:27:31.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50798 req_id = 23e7f986-a084-467b-b2f6-c460c27913be response_code = 200 uri = /artifacts
27162025-01-30T20:27:31.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
27172025-01-30T20:27:31.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45286 req_id = a84a5d86-4e2e-4b05-aeb8-a5cf75041804 response_code = 204 uri = /eip-gateways
27182025-01-30T20:27:31.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45286 req_id = 86e01c49-0a4f-450b-b6e4-da9c85d8f888 response_code = 204 uri = /vpc-routes
27192025-01-30T20:27:31.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63845
27202025-01-30T20:27:31.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63845 req_id = 10f05ede-ad7c-4687-a387-7081536629a8 response_code = 200 uri = /vpc-routes
27212025-01-30T20:27:31.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49940
27222025-01-30T20:27:31.719ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27232025-01-30T20:27:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49940 req_id = 4ab99bf9-ae75-45a7-ae2a-c795a6cd69d1 response_code = 200 uri = /artifacts
27242025-01-30T20:27:31.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35611
27252025-01-30T20:27:31.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27262025-01-30T20:27:31.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27272025-01-30T20:27:31.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
27282025-01-30T20:27:31.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
27292025-01-30T20:27:31.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36814
27302025-01-30T20:27:31.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
27312025-01-30T20:27:31.755ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27322025-01-30T20:27:31.755ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_267308a4-806f-4489-9002-d2fdc6345ade
27332025-01-30T20:27:31.792ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27342025-01-30T20:27:31.792ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2
27352025-01-30T20:27:31.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
27362025-01-30T20:27:31.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64395
27372025-01-30T20:27:31.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
27382025-01-30T20:27:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63845 req_id = 3a688e54-cbc3-451d-9671-73af64503961 response_code = 204 uri = /eip-gateways
27392025-01-30T20:27:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64395 req_id = 05694eca-4feb-4f79-b78d-fab2eb7f22db response_code = 200 uri = /v2p
27402025-01-30T20:27:31.824ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412025-01-30T20:27:31.824ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7414a064-4217-4398-b36a-c06130bcb569
27422025-01-30T20:27:31.852ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27432025-01-30T20:27:31.852ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d
27442025-01-30T20:27:31.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45222
27452025-01-30T20:27:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45222 req_id = cdc0dd73-3963-4fc4-916a-f22225a5b27a response_code = 200 uri = /v2p
27462025-01-30T20:27:31.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36814 req_id = 873b1bb8-f0b3-45e8-9abf-5e746a94d58e response_code = 204 uri = /switch-ports
27472025-01-30T20:27:31.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36814 req_id = 25eb0fa0-78e9-4c3b-8f24-0adcc6ff01e9 response_code = 200 uri = /network-bootstore-config
27482025-01-30T20:27:31.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34469
27492025-01-30T20:27:31.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27502025-01-30T20:27:31.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27512025-01-30T20:27:31.877ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
27522025-01-30T20:27:31.877ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
27532025-01-30T20:27:31.882ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27542025-01-30T20:27:31.882ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad
27552025-01-30T20:27:31.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60900
27562025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27572025-01-30T20:27:31.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63845 req_id = ba9978e6-6565-47fe-bc95-907fc9852545 response_code = 204 uri = /vpc-routes
27582025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27592025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27602025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27612025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27622025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27632025-01-30T20:27:31.890ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27642025-01-30T20:27:31.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 710 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60900 req_id = 28714e07-cc67-47bc-b270-53371ee72242 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27652025-01-30T20:27:31.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43031
27662025-01-30T20:27:31.903ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27672025-01-30T20:27:31.903ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_267308a4-806f-4489-9002-d2fdc6345ade
27682025-01-30T20:27:31.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27692025-01-30T20:27:31.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27702025-01-30T20:27:31.917ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/config/omicron-zones.json file = common/src/ledger.rs:177
27712025-01-30T20:27:31.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56998
27722025-01-30T20:27:31.929ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/config/omicron-zones.json file = common/src/ledger.rs:177
27732025-01-30T20:27:31.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
27742025-01-30T20:27:31.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27752025-01-30T20:27:31.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e
27762025-01-30T20:27:31.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33865
27772025-01-30T20:27:31.954ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27782025-01-30T20:27:31.954ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2
27792025-01-30T20:27:31.971ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 267308a4-806f-4489-9002-d2fdc6345ade (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27802025-01-30T20:27:31.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_267308a4-806f-4489-9002-d2fdc6345ade
27812025-01-30T20:27:31.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
27822025-01-30T20:27:31.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27832025-01-30T20:27:31.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f
27842025-01-30T20:27:32.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56960ed3-4d27-4f9d-9bb0-07644c852cd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27852025-01-30T20:27:32.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_56960ed3-4d27-4f9d-9bb0-07644c852cd2
27862025-01-30T20:27:32.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59732
27872025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27882025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27892025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27902025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27912025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27922025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27932025-01-30T20:27:32.009ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942025-01-30T20:27:32.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 834 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59732 req_id = 4dbf606f-01be-403c-a3a3-ef01ee879555 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27952025-01-30T20:27:32.019ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27962025-01-30T20:27:32.019ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7414a064-4217-4398-b36a-c06130bcb569
27972025-01-30T20:27:32.042ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27982025-01-30T20:27:32.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9
27992025-01-30T20:27:32.055ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28002025-01-30T20:27:32.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56998 req_id = 804bdc49-f1ed-436f-bbb5-c20af6397582 response_code = 204 uri = /switch-ports
28012025-01-30T20:27:32.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56998 req_id = 5baec48c-5bc3-4f87-b36a-14a56869d898 response_code = 200 uri = /network-bootstore-config
28022025-01-30T20:27:32.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28032025-01-30T20:27:32.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d
28042025-01-30T20:27:32.077ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7414a064-4217-4398-b36a-c06130bcb569 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28052025-01-30T20:27:32.077ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7414a064-4217-4398-b36a-c06130bcb569
28062025-01-30T20:27:32.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32929
28072025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28082025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28092025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28102025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28112025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28122025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28132025-01-30T20:27:32.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28142025-01-30T20:27:32.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 865 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32929 req_id = 9c74a4e2-965c-43de-81bb-f8938de769b4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28152025-01-30T20:27:32.096ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28162025-01-30T20:27:32.096ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04f8928-4530-4288-b470-e4b4780b8353
28172025-01-30T20:27:32.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28182025-01-30T20:27:32.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9b53ac3-7b5c-4ce8-8399-55474ddbe27d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28192025-01-30T20:27:32.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9b53ac3-7b5c-4ce8-8399-55474ddbe27d
28202025-01-30T20:27:32.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28212025-01-30T20:27:32.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad
28222025-01-30T20:27:32.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 399481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35611 req_id = 02550ea1-ed42-484e-b441-44565051f15b response_code = 200 uri = /inventory
28232025-01-30T20:27:32.151ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28242025-01-30T20:27:32.152ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e
28252025-01-30T20:27:32.166ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2c36b03-4d4c-4836-8cc7-d8d09991a0ad (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-01-30T20:27:32.166ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2c36b03-4d4c-4836-8cc7-d8d09991a0ad
28272025-01-30T20:27:32.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33865 req_id = f551a194-656a-48b2-a115-d0e9f3dff0f0 response_code = 204 uri = /switch-ports
28282025-01-30T20:27:32.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33865 req_id = b1640c74-d93d-4b20-a1e2-d40ea4ddf1ae response_code = 200 uri = /network-bootstore-config
28292025-01-30T20:27:32.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28302025-01-30T20:27:32.183ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f
28312025-01-30T20:27:32.198ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3f6b536f-4a04-4422-a92f-9a12ce3e112e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28322025-01-30T20:27:32.198ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3f6b536f-4a04-4422-a92f-9a12ce3e112e
28332025-01-30T20:27:32.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eb782ae8-202d-4b31-b075-6b9d2fd8126f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28342025-01-30T20:27:32.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eb782ae8-202d-4b31-b075-6b9d2fd8126f
28352025-01-30T20:27:32.237ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28362025-01-30T20:27:32.237ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9
28372025-01-30T20:27:32.257ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4af3c38-c4fd-4361-bbf8-e7ff92e446e9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28382025-01-30T20:27:32.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4af3c38-c4fd-4361-bbf8-e7ff92e446e9
28392025-01-30T20:27:32.273ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28402025-01-30T20:27:32.273ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04f8928-4530-4288-b470-e4b4780b8353
28412025-01-30T20:27:32.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 414768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34469 req_id = 1c1e65f2-3616-43cf-9fb1-20b8d2e73ab2 response_code = 200 uri = /inventory
28422025-01-30T20:27:32.297ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04f8928-4530-4288-b470-e4b4780b8353 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28432025-01-30T20:27:32.297ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04f8928-4530-4288-b470-e4b4780b8353
28442025-01-30T20:27:32.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 417356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43031 req_id = b517cd13-270a-4b18-84ab-633f981fc8b4 response_code = 200 uri = /inventory
28452025-01-30T20:27:46.061ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51353
28462025-01-30T20:27:46.061ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51353 req_id = b9df15b3-7fb9-4002-a98c-f134774182ef response_code = 200 uri = /baseboard
28472025-01-30T20:27:47.455ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6339 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 1f6496b9-5829-40bd-a449-10d9aebf1f43 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
28482025-01-30T20:28:00.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62361
28492025-01-30T20:28:00.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62361 req_id = 66f0b371-46fd-4ecf-84f5-7caa979f8bed response_code = 200 uri = /vpc-routes
28502025-01-30T20:28:01.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
28512025-01-30T20:28:01.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62361 req_id = 133cd884-dfda-47c9-9871-6f4a9a1b484a response_code = 204 uri = /eip-gateways
28522025-01-30T20:28:01.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36011
28532025-01-30T20:28:01.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36011 req_id = 8cce3bf3-22be-4ccb-b1d5-96f298fd9b03 response_code = 200 uri = /v2p
28542025-01-30T20:28:01.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62361 req_id = d6c50229-78c1-4f2d-a682-4d994e5f56da response_code = 204 uri = /vpc-routes
28552025-01-30T20:28:01.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60100
28562025-01-30T20:28:01.104ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28572025-01-30T20:28:01.151ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28582025-01-30T20:28:01.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60100 req_id = 327336e0-6001-4852-8e6b-0c465b28ab2d response_code = 204 uri = /switch-ports
28592025-01-30T20:28:01.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60100 req_id = 05feda51-d97f-4969-8d69-7f0cc1e5bdf5 response_code = 200 uri = /network-bootstore-config
28602025-01-30T20:28:01.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49293
28612025-01-30T20:28:01.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49293 req_id = e9ecbf5a-44ac-4e11-aa23-92312d5f28d6 response_code = 200 uri = /vpc-routes
28622025-01-30T20:28:01.391ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
28632025-01-30T20:28:01.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49293 req_id = 11719095-2ac4-43b0-a323-f561fdef0711 response_code = 204 uri = /eip-gateways
28642025-01-30T20:28:01.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49293 req_id = 611ff839-a17d-40d6-ab7b-00ced35f6671 response_code = 204 uri = /vpc-routes
28652025-01-30T20:28:01.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41591
28662025-01-30T20:28:01.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41591 req_id = 6ec2cdaa-6feb-4db4-902f-656345067258 response_code = 200 uri = /v2p
28672025-01-30T20:28:01.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62866
28682025-01-30T20:28:01.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62866 req_id = 9e30e55b-f105-4db7-adb8-cd546a6218a5 response_code = 200 uri = /vpc-routes
28692025-01-30T20:28:01.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34703
28702025-01-30T20:28:01.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28712025-01-30T20:28:01.499ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28722025-01-30T20:28:01.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34703 req_id = c16a0a23-2491-46ee-a689-a60af16f3aba response_code = 204 uri = /switch-ports
28732025-01-30T20:28:01.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46680
28742025-01-30T20:28:01.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64985
28752025-01-30T20:28:01.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46680 req_id = d4c1f5c1-7b29-4d56-b10f-3b7ac1197757 response_code = 200 uri = /v2p
28762025-01-30T20:28:01.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
28772025-01-30T20:28:01.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28782025-01-30T20:28:01.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62866 req_id = 56acc922-8e8b-47d8-92cc-01dd7f6ec911 response_code = 204 uri = /eip-gateways
28792025-01-30T20:28:01.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34703 req_id = 30a79ba4-f354-41ce-b928-6255789e82ae response_code = 200 uri = /network-bootstore-config
28802025-01-30T20:28:01.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62866 req_id = 06e50a2a-963a-4c3d-8b44-6ab41b1461e1 response_code = 204 uri = /vpc-routes
28812025-01-30T20:28:01.584ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28822025-01-30T20:28:01.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64985 req_id = 2a861bef-d9e8-4232-a6c9-a6e7c3a67cda response_code = 204 uri = /switch-ports
28832025-01-30T20:28:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64985 req_id = 134f670c-44ce-4db1-96f8-0cf8258b889a response_code = 200 uri = /network-bootstore-config
28842025-01-30T20:28:16.094ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41862
28852025-01-30T20:28:16.094ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41862 req_id = df1e346c-adf3-4fb6-9df7-36c5c887609b response_code = 200 uri = /baseboard
28862025-01-30T20:28:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6525 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = ababc8c0-1304-4b5a-beeb-1e500476b7ff response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
28872025-01-30T20:28:31.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49053
28882025-01-30T20:28:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49053 req_id = 9882cae6-df70-4d7c-acb7-5dcc76dff30d response_code = 200 uri = /v2p
28892025-01-30T20:28:31.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54328
28902025-01-30T20:28:31.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54328 req_id = e1ea6f97-e31b-4e6a-9998-25d07105e4d8 response_code = 200 uri = /vpc-routes
28912025-01-30T20:28:31.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
28922025-01-30T20:28:31.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54328 req_id = 83f68e5d-93dd-427d-8663-c2f03235c2ce response_code = 204 uri = /eip-gateways
28932025-01-30T20:28:31.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54328 req_id = c4997d29-bb73-4bb0-bdb8-22585ba0d656 response_code = 204 uri = /vpc-routes
28942025-01-30T20:28:31.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47623
28952025-01-30T20:28:31.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47623 req_id = 807bf779-d7e8-4d58-91d9-3fc7b56036f9 response_code = 200 uri = /vpc-routes
28962025-01-30T20:28:31.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63479
28972025-01-30T20:28:31.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
28982025-01-30T20:28:31.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
28992025-01-30T20:28:31.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63479 req_id = 2ab6e351-f914-4ecb-a6cd-71021699638c response_code = 204 uri = /switch-ports
29002025-01-30T20:28:31.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
29012025-01-30T20:28:31.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47623 req_id = 674ee5a5-3aaf-4cc6-b9fd-a9b5d5b1f296 response_code = 204 uri = /eip-gateways
29022025-01-30T20:28:31.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63479 req_id = 02916e56-5ec3-4663-9109-f24ef6812423 response_code = 200 uri = /network-bootstore-config
29032025-01-30T20:28:31.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47623 req_id = dfb149e1-2858-4787-8943-d81793107395 response_code = 204 uri = /vpc-routes
29042025-01-30T20:28:31.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33422
29052025-01-30T20:28:31.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29062025-01-30T20:28:31.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29072025-01-30T20:28:31.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100558 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33422 req_id = 9962a8d4-8dce-45e6-82c9-0943d78ddf04 response_code = 204 uri = /switch-ports
29082025-01-30T20:28:31.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52845
29092025-01-30T20:28:31.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37225
29102025-01-30T20:28:31.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37225 req_id = 22a55155-1e42-422f-b272-fe8bbfc6bef7 response_code = 200 uri = /v2p
29112025-01-30T20:28:31.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33422 req_id = 21f735ee-c057-4ee1-a1fc-4519c932c737 response_code = 200 uri = /network-bootstore-config
29122025-01-30T20:28:31.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52845 req_id = 1ff52194-48e9-4a54-9550-824df0ded5d7 response_code = 200 uri = /vpc-routes
29132025-01-30T20:28:31.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51458
29142025-01-30T20:28:31.669ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29152025-01-30T20:28:31.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29162025-01-30T20:28:31.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51458 req_id = e4336c34-0d61-49fe-973b-fa9f006edd9e response_code = 204 uri = /switch-ports
29172025-01-30T20:28:31.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64875
29182025-01-30T20:28:31.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
29192025-01-30T20:28:31.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52845 req_id = 49bf27bc-91b7-42d4-be77-368b4c92d6f0 response_code = 204 uri = /eip-gateways
29202025-01-30T20:28:31.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51458 req_id = 5156c798-8e5c-4bfe-aaa0-11f5d71398b1 response_code = 200 uri = /network-bootstore-config
29212025-01-30T20:28:31.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64875 req_id = 8501f8e2-97a7-4a3e-8b9b-371965e05b96 response_code = 200 uri = /v2p
29222025-01-30T20:28:31.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52845 req_id = 1201d4ef-ecf7-4c39-8bf9-66e4aedb291d response_code = 204 uri = /vpc-routes
29232025-01-30T20:28:46.126ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62005
29242025-01-30T20:28:46.126ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62005 req_id = 62f673f1-4bb8-4558-aa68-8fafb868efd4 response_code = 200 uri = /baseboard
29252025-01-30T20:28:47.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6699 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = be9c5baa-c1ce-4e17-8e47-fbd1d51bd984 response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
29262025-01-30T20:29:00.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33370
29272025-01-30T20:29:00.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33370 req_id = cc5b4f92-194c-47c6-b19e-da0ded551ea0 response_code = 200 uri = /vpc-routes
29282025-01-30T20:29:01.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
29292025-01-30T20:29:01.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33370 req_id = 5c71e4ad-8341-4806-bec9-aa5b84e1405b response_code = 204 uri = /eip-gateways
29302025-01-30T20:29:01.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33887
29312025-01-30T20:29:01.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33887 req_id = 709cd14c-ed7b-4840-b7f8-241f4dabe9b2 response_code = 200 uri = /v2p
29322025-01-30T20:29:01.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33370 req_id = 69a5696f-c4f9-4eea-bbab-5a40c476197d response_code = 204 uri = /vpc-routes
29332025-01-30T20:29:01.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51318
29342025-01-30T20:29:01.208ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29352025-01-30T20:29:01.260ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29362025-01-30T20:29:01.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51318 req_id = 05993e39-9d20-4990-b450-7f5bbda6d644 response_code = 204 uri = /switch-ports
29372025-01-30T20:29:01.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51318 req_id = 4fdfd100-7632-42db-ae40-c6fc277e0188 response_code = 200 uri = /network-bootstore-config
29382025-01-30T20:29:01.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64194
29392025-01-30T20:29:01.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64194 req_id = aac5b8e1-7f27-4462-b981-97a405ccfbf2 response_code = 200 uri = /vpc-routes
29402025-01-30T20:29:01.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
29412025-01-30T20:29:01.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64194 req_id = 424a464c-ced7-4ef5-995a-cd73869aa5fc response_code = 204 uri = /eip-gateways
29422025-01-30T20:29:01.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64194 req_id = b496da79-25ab-4922-8ac9-2f953d73c1ea response_code = 204 uri = /vpc-routes
29432025-01-30T20:29:01.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38261
29442025-01-30T20:29:01.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38261 req_id = e0e7fd21-552c-4082-9f71-cf228427003f response_code = 200 uri = /vpc-routes
29452025-01-30T20:29:01.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57282
29462025-01-30T20:29:01.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57282 req_id = a14d5263-0635-4148-836c-2bf28f36310b response_code = 200 uri = /v2p
29472025-01-30T20:29:01.516ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
29482025-01-30T20:29:01.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38261 req_id = 1aa9c3ad-6727-423c-b2b3-e4b403bb3310 response_code = 204 uri = /eip-gateways
29492025-01-30T20:29:01.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38261 req_id = 78735c94-c5a1-4f66-bc56-1a5da725cf4c response_code = 204 uri = /vpc-routes
29502025-01-30T20:29:01.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48880
29512025-01-30T20:29:01.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29522025-01-30T20:29:01.569ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29532025-01-30T20:29:01.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48880 req_id = a409853c-e13a-4278-926f-7eb22069eea3 response_code = 204 uri = /switch-ports
29542025-01-30T20:29:01.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50278
29552025-01-30T20:29:01.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49119
29562025-01-30T20:29:01.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50278 req_id = 54831763-6758-4a05-9fc2-ca52a1cc4d79 response_code = 200 uri = /v2p
29572025-01-30T20:29:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48880 req_id = a796d67a-3137-457e-b669-5427fe7b2427 response_code = 200 uri = /network-bootstore-config
29582025-01-30T20:29:01.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4108
29592025-01-30T20:29:01.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4132
29602025-01-30T20:29:01.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49119 req_id = c0efc229-56d1-4037-bc64-9c22ab2f30af response_code = 204 uri = /switch-ports
29612025-01-30T20:29:01.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49119 req_id = 8641240a-5e2b-4f1e-8897-83f052b0e1ed response_code = 200 uri = /network-bootstore-config
29622025-01-30T20:29:02.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51535
29632025-01-30T20:29:02.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51535 req_id = 4a051671-8fb2-4475-bc86-762ff12c41f0 response_code = 200 uri = /v2p
29642025-01-30T20:29:02.368ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(3294993) }
29652025-01-30T20:29:02.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51535 req_id = 5d33568c-60d6-42e2-8beb-4d3231b283c1 response_code = 204 uri = /v2p
29662025-01-30T20:29:02.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40802
29672025-01-30T20:29:02.390ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3294993))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: de4fc36b-23ea-4023-9017-100c4c64861f, slot: 0, read_only: false, vcr_json: .., name: "disk-a8741f2eb3b" }], boot_settings: Some(InstanceBootSettings { order: [de4fc36b-23ea-4023-9017-100c4c64861f] }), cloud_init_bytes: Some(..) } instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 metadata = InstanceMetadata { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, project_id: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-30T20:29:02.384612511Z }
29682025-01-30T20:29:02.390ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 migration_id = None propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29692025-01-30T20:29:02.391ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1564 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 migration_id = None propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3294993))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e66a101d-94ac-4648-b10e-500361ee8d91, kind: Instance { id: d59fcf7d-4765-4f60-8946-4e33b60c5af2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3294993), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: de4fc36b-23ea-4023-9017-100c4c64861f, slot: 0, read_only: false, vcr_json: .., name: "disk-a8741f2eb3b" }], boot_settings: Some(InstanceBootSettings { order: [de4fc36b-23ea-4023-9017-100c4c64861f] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-30T20:29:02.384612511Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29702025-01-30T20:29:02.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8042 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40802 req_id = 49b64965-6f8a-4969-bfee-4fd56f12b1b5 response_code = 200 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
29712025-01-30T20:29:02.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59733
29722025-01-30T20:29:02.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1621 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59733 req_id = b9471cbd-1b57-4d51-8fd7-2a544de41068 response_code = 200 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a/state
29732025-01-30T20:29:02.516ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 3294993 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29742025-01-30T20:29:02.516ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29752025-01-30T20:29:02.558ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a file = illumos-utils/src/zone.rs:325 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29762025-01-30T20:29:02.582ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a file = illumos-utils/src/zone.rs:363 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29772025-01-30T20:29:02.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52061
29782025-01-30T20:29:02.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52061 req_id = 2587faf8-6f2e-42c0-a610-105b6b345abc response_code = 200 uri = /vpc-routes
29792025-01-30T20:29:02.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {e66a101d-94ac-4648-b10e-500361ee8d91: {10.151.1.175: {a5a5f305-6a5e-4b9a-acf0-6c95db7c6b4b}, 10.151.1.176: {a5a5f305-6a5e-4b9a-acf0-6c95db7c6b4b}}} }
29802025-01-30T20:29:03.931ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29812025-01-30T20:29:03.931ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a zone file = illumos-utils/src/running_zone.rs:488 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29822025-01-30T20:29:04.182ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 45.800353ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29832025-01-30T20:29:04.236ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 97.056643ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29842025-01-30T20:29:04.357ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 121.365945ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29852025-01-30T20:29:04.492ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 253.742235ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29862025-01-30T20:29:04.757ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 466.627884ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29872025-01-30T20:29:05.240ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 1.324001221s file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29882025-01-30T20:29:06.578ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 721.730653ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29892025-01-30T20:29:07.312ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 1.24256448s file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29902025-01-30T20:29:08.568ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 1.014315307s file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a zone = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
29912025-01-30T20:29:09.612ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a file = sled-agent/src/instance.rs:2072 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29922025-01-30T20:29:09.620ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a") failed: Property not found. retry in 73.341136ms file = illumos-utils/src/svc.rs:42 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29932025-01-30T20:29:09.705ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2081 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29942025-01-30T20:29:09.742ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2105 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29952025-01-30T20:29:09.817ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1215 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29962025-01-30T20:29:09.818ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
29972025-01-30T20:29:09.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7137392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52061 req_id = b7041771-5ab4-426e-8def-bce87f0cbb17 response_code = 204 uri = /eip-gateways
29982025-01-30T20:29:09.819ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-30T20:29:09.819752076Z } file = sled-agent/src/instance.rs:782 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
29992025-01-30T20:29:09.819ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-30T20:29:09.819752076Z } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30002025-01-30T20:29:09.819ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-30T20:29:09.819752076Z }, migration_in: None, migration_out: None }
30012025-01-30T20:29:09.863ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-30T20:29:09.863754477Z } file = sled-agent/src/instance.rs:782 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30022025-01-30T20:29:09.863ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-30T20:29:09.863754477Z } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30032025-01-30T20:29:09.863ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-30T20:29:09.863754477Z }, migration_in: None, migration_out: None }
30042025-01-30T20:29:09.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52061 req_id = 445eb704-e572-43b9-8fdd-2746a807003c response_code = 204 uri = /vpc-routes
30052025-01-30T20:29:16.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39809
30062025-01-30T20:29:16.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39809 req_id = 234d00bc-da99-4ddb-b897-011a990d7721 response_code = 200 uri = /baseboard
30072025-01-30T20:29:17.456ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6831 local_addr = [fd00:1122:3344:101::1]:52655 method = GET remote_addr = [fd00:1122:3344:101::d]:37331 req_id = 857a0ca4-576f-4439-89a1-eb3644b0685f response_code = 200 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a uri = /80be2cf5-c1f1-42e5-8353-289dd0bb621a
30082025-01-30T20:29:20.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48559
30092025-01-30T20:29:20.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48559 req_id = 4d4ed774-6aa3-4b05-9a03-468ab9d9b9cb response_code = 200 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a/state
30102025-01-30T20:29:20.057ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-30T20:29:20.057509765Z } file = sled-agent/src/instance.rs:782 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30112025-01-30T20:29:20.057ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-30T20:29:20.057509765Z } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30122025-01-30T20:29:20.057ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-30T20:29:20.057509765Z }, migration_in: None, migration_out: None }
30132025-01-30T20:29:20.099ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-30T20:29:20.099597573Z } file = sled-agent/src/instance.rs:782 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30142025-01-30T20:29:20.099ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:804 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-30T20:29:20.099597573Z } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30152025-01-30T20:29:20.099ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:818 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30162025-01-30T20:29:20.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30172025-01-30T20:29:20.099ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 1137525581044688911 n_samples = 6 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
30182025-01-30T20:29:20.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30192025-01-30T20:29:20.100ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/19eaa796-af5f-4483-a2b4-768d577d90e1/debug/bundle/zone", "/pool/int/9e3c9e96-a0f5-4329-bdf7-96327d1c5427/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/267308a4-806f-4489-9002-d2fdc6345ade/crypt/debug", "/pool/ext/56960ed3-4d27-4f9d-9bb0-07644c852cd2/crypt/debug", "/pool/ext/7414a064-4217-4398-b36a-c06130bcb569/crypt/debug", "/pool/ext/f9b53ac3-7b5c-4ce8-8399-55474ddbe27d/crypt/debug", "/pool/ext/b2c36b03-4d4c-4836-8cc7-d8d09991a0ad/crypt/debug", "/pool/ext/3f6b536f-4a04-4422-a92f-9a12ce3e112e/crypt/debug", "/pool/ext/eb782ae8-202d-4b31-b075-6b9d2fd8126f/crypt/debug", "/pool/ext/d4af3c38-c4fd-4361-bbf8-e7ff92e446e9/crypt/debug", "/pool/ext/e04f8928-4530-4288-b470-e4b4780b8353/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a
30202025-01-30T20:29:20.100ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 3771554964891889701 n_samples = 6 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
30212025-01-30T20:29:20.742ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a", bundle_id: 89e71a90-4c4b-4c56-9d6a-9694bca90f5e }, time_created: 2025-01-30T20:29:20.100862028Z, version: 0, cause: TerminatedInstance }
30222025-01-30T20:29:20.742ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_a7d75321-6410-4aa2-8dba-96cd43cec01a file = sled-agent/src/instance.rs:1315 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30232025-01-30T20:29:22.494ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30242025-01-30T20:29:22.511ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3294993), kind: System }
30252025-01-30T20:29:22.511ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3294993), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30262025-01-30T20:29:22.511ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-30T20:29:22.511842292Z }, migration_in: None, migration_out: None }
30272025-01-30T20:29:22.561ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:701 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-30T20:29:22.511842292Z }, migration_in: None, migration_out: None }
30282025-01-30T20:29:22.565ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1252 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a
30292025-01-30T20:29:23.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62276
30302025-01-30T20:29:23.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62276 req_id = 48ad8e49-a22d-4eaa-9888-04ac5f768300 response_code = 200 uri = /vpc-routes
30312025-01-30T20:29:23.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
30322025-01-30T20:29:23.086ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
30332025-01-30T20:29:23.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62276 req_id = 9b9a3a29-b28c-4795-b78a-9e5f9dc04fef response_code = 204 uri = /eip-gateways
30342025-01-30T20:29:23.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62276 req_id = 2dca07fb-296c-485b-bfb2-b8896a87320d response_code = 204 uri = /vpc-routes
30352025-01-30T20:29:23.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36570
30362025-01-30T20:29:23.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36570 req_id = 0f7ed42a-e9c2-4c57-b6f9-0010768dc8df response_code = 200 uri = /v2p
30372025-01-30T20:29:24.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60582
30382025-01-30T20:29:24.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60582 req_id = bfb68288-8f12-4390-8dcc-872df1d02ac1 response_code = 200 uri = /v2p
30392025-01-30T20:29:24.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39377
30402025-01-30T20:29:24.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39377 req_id = 089be941-dc67-4221-9c97-bb7d1c95720b response_code = 200 uri = /vpc-routes
30412025-01-30T20:29:24.536ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
30422025-01-30T20:29:24.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39377 req_id = 8a9b3471-a3c1-4fc5-89ba-952e31d345ac response_code = 204 uri = /eip-gateways
30432025-01-30T20:29:24.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39377 req_id = d69be0a5-f24d-4c55-9bed-beef81ccb428 response_code = 204 uri = /vpc-routes
30442025-01-30T20:29:25.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48039
30452025-01-30T20:29:25.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48039 req_id = 95a1ecd9-d437-4d46-b0c2-bf83b2f61fd9 response_code = 200 uri = /vpc-routes
30462025-01-30T20:29:25.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = 80be2cf5-c1f1-42e5-8353-289dd0bb621a values = ExternalIpGatewayMap { mappings: {} }
30472025-01-30T20:29:25.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48039 req_id = 3767784d-edf7-4954-8e83-2a2fbce45138 response_code = 204 uri = /eip-gateways
30482025-01-30T20:29:25.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48039 req_id = 28635a36-985e-43e0-beb0-df8dd8ec3807 response_code = 204 uri = /vpc-routes