Max level shown:
1 [ Mar 8 00:36:13 Enabled. ]
2 [ Mar 8 00:36:13 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 8 00:36:13 Method "start" exited with status 0. ]
4 [ Mar 8 00:36:13 Rereading configuration. ]
5 [ Mar 8 00:36:13 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-08T00:36:13.233ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-08T00:36:13.233ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-08T00:36:13.287ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-08T00:36:13.287ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-08T00:36:13.402ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-08T00:36:13.411ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-08T00:36:13.419ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-08T00:36:14.030ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
152025-03-08T00:36:14.032ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }]
162025-03-08T00:36:14.032ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
172025-03-08T00:36:14.161ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-08T00:36:14.161ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-08T00:36:14.161ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-08T00:36:14.161ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
212025-03-08T00:36:14.161ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
222025-03-08T00:36:14.161ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
232025-03-08T00:36:14.164ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-08T00:36:14.164ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-08T00:36:14.164ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-08T00:36:14.164ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-08T00:36:14.164ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-08T00:36:14.164ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-08T00:36:14.164ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-08T00:36:14.164ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-08T00:36:14.164ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-08T00:36:14.176ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-08T00:36:14.176ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool)
342025-03-08T00:36:14.300ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal }
352025-03-08T00:36:14.749ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-08T00:36:14.749ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-08T00:36:14.749ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-08T00:36:14.749ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-08T00:36:14.749ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-08T00:36:14.749ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-08T00:36:14.749ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-08T00:36:14.758ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-08T00:36:14.758ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool)
442025-03-08T00:36:14.863ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal }
452025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
492025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
502025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
552025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
562025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
582025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
602025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
612025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
622025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
782025-03-08T00:36:15.318ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
792025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
802025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
812025-03-08T00:36:15.318ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-08T00:36:15.318ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
832025-03-08T00:36:15.318ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842025-03-08T00:36:15.318ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
852025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
862025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
872025-03-08T00:36:15.319ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
882025-03-08T00:36:15.319ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892025-03-08T00:36:15.319ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902025-03-08T00:36:15.319ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
922025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
932025-03-08T00:36:15.319ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
942025-03-08T00:36:15.319ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
952025-03-08T00:36:15.319ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
962025-03-08T00:36:15.319ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
982025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
992025-03-08T00:36:15.319ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-08T00:36:15.319ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1012025-03-08T00:36:15.319ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1022025-03-08T00:36:15.319ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1032025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1042025-03-08T00:36:15.319ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1052025-03-08T00:36:15.319ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1072025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1082025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1092025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1102025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-sock-i86pc
1112025-03-08T00:36:15.319ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1122025-03-08T00:36:15.319ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-08T00:36:15.319ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-08T00:36:15.329ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:794
1152025-03-08T00:36:15.329ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 1258, tv_nsec: 674758625 } time_to_next_cleanup = 599.999941209s
1162025-03-08T00:36:15.329ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
1172025-03-08T00:36:15.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-08T00:36:15.330ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-08T00:36:15.330ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-08T00:36:15.333ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1212025-03-08T00:36:15.335ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1222025-03-08T00:36:15.335ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1257
1232025-03-08T00:36:15.335ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-08T00:36:15.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-08T00:36:15.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-08T00:36:15.335ZINFOSledAgent (RSS): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-08T00:36:15.335ZINFOSledAgent (RSS): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-08T00:36:15.335ZINFOSledAgent (RSS): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-08T00:36:15.335ZINFOSledAgent (RSS): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-08T00:36:15.335ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1306
1312025-03-08T00:36:15.335ZINFOSledAgent (RSS): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-08T00:36:15.336ZINFOSledAgent (RSS): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-08T00:36:15.336ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1338
1342025-03-08T00:36:15.336ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-08T00:36:15.336ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-08T00:36:15.336ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1369
1372025-03-08T00:36:15.336ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382025-03-08T00:36:15.336ZINFOSledAgent (bootstore): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1392025-03-08T00:36:15.336ZINFOSledAgent (bootstore): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
1402025-03-08T00:36:15.336ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412025-03-08T00:36:15.336ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 87826585-0843-40d2-a3ce-382fa54dbc5c (sled), rack_id: 533106a5-4f1c-4a48-aa36-2a30759fbe03, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422025-03-08T00:36:15.337ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4319
1432025-03-08T00:36:15.337ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4740
1442025-03-08T00:36:15.342ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-08T00:36:15.347ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-08T00:36:15.347ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-08T00:36:15.352ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-08T00:36:15.352ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-08T00:36:15.353ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:51726
1502025-03-08T00:36:15.353ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 87826585-0843-40d2-a3ce-382fa54dbc5c (sled), rack_id: 533106a5-4f1c-4a48-aa36-2a30759fbe03, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:358
1512025-03-08T00:36:15.353ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:373
1522025-03-08T00:36:15.353ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1542025-03-08T00:36:15.353ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1552025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-08T00:36:15.353ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1622025-03-08T00:36:15.353ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-08T00:36:15.369ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-08T00:36:15.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:327
1652025-03-08T00:36:15.406ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:365
1662025-03-08T00:36:15.417ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1672025-03-08T00:36:15.418ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1682025-03-08T00:36:15.418ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1692025-03-08T00:36:15.418ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
1702025-03-08T00:36:15.421ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1712025-03-08T00:36:15.421ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
1722025-03-08T00:36:15.421ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
1732025-03-08T00:36:15.421ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f8ffe0f4-e05e-484c-8984-da64d110b61b", "content-length": "124", "date": "Sat, 08 Mar 2025 00:36:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f8ffe0f4-e05e-484c-8984-da64d110b61b" } file = sled-agent/src/ddm_reconciler.rs:193
1742025-03-08T00:36:15.432ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_522901ce-0715-43a8-8d70-a8fac8d50c94/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-08T00:36:15.458ZINFOSledAgent: successfully created encrypted zvol: name="oxi_522901ce-0715-43a8-8d70-a8fac8d50c94/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-08T00:36:15.458ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_522901ce-0715-43a8-8d70-a8fac8d50c94/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-08T00:36:15.463ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1782025-03-08T00:36:15.463ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-08T00:36:15.463ZINFOSledAgent (BackingFs): Ensuring dataset oxi_522901ce-0715-43a8-8d70-a8fac8d50c94/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-08T00:36:15.544ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-08T00:36:15.762ZINFOSledAgent (BackingFs): Mounting oxi_522901ce-0715-43a8-8d70-a8fac8d50c94/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-08T00:36:15.775ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-08T00:36:15.775ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-08T00:36:15.775ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-08T00:36:15.775ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-08T00:36:16.529ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1872025-03-08T00:36:16.535ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:39407 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1882025-03-08T00:36:16.535ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1892025-03-08T00:36:16.535ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:39407 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 87826585-0843-40d2-a3ce-382fa54dbc5c sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1902025-03-08T00:36:16.536ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 206.808417ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1912025-03-08T00:36:16.537ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1922025-03-08T00:36:16.537ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1932025-03-08T00:36:16.537ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:981 underlay_address = fd00:1122:3344:101::1
1942025-03-08T00:36:16.537ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-08T00:36:16.745ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 688.077087ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1962025-03-08T00:36:17.435ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.009246887s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1972025-03-08T00:36:18.445ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.845401407s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
1982025-03-08T00:36:19.387ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2737
1992025-03-08T00:36:19.388ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2967
2002025-03-08T00:36:19.388ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2607
2012025-03-08T00:36:19.388ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2654
2022025-03-08T00:36:19.388ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3048
2032025-03-08T00:36:19.388ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3093
2042025-03-08T00:36:19.389ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2875
2052025-03-08T00:36:19.391ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2648
2062025-03-08T00:36:19.391ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='092db7f2-f715-4a03-9cca-1b91536a4fd0'/> <propval type="astring" name="rack_id" value='533106a5-4f1c-4a48-aa36-2a30759fbe03'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea3:b46b'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='533106a5-4f1c-4a48-aa36-2a30759fbe03'/> <propval type="astring" name="sled_id" value='87826585-0843-40d2-a3ce-382fa54dbc5c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='533106a5-4f1c-4a48-aa36-2a30759fbe03'/> <propval type="astring" name="sled_id" value='87826585-0843-40d2-a3ce-382fa54dbc5c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='87826585-0843-40d2-a3ce-382fa54dbc5c'/> <propval type="astring" name="rack_uuid" value='533106a5-4f1c-4a48-aa36-2a30759fbe03'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='87826585-0843-40d2-a3ce-382fa54dbc5c'/> <propval type="astring" name="rack_uuid" value='533106a5-4f1c-4a48-aa36-2a30759fbe03'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2072025-03-08T00:36:19.391ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2082025-03-08T00:36:19.701ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 47.84004ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2092025-03-08T00:36:19.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 145.629502ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-08T00:36:20.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 164.268546ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-08T00:36:20.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 377.357778ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-08T00:36:20.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.049799042s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-03-08T00:36:21.293ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.649470531s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2142025-03-08T00:36:21.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.318545749s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-08T00:36:23.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.403282235s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-08T00:36:23.944ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.963907137s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2172025-03-08T00:36:24.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 983.597115ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-03-08T00:36:26.217ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2192025-03-08T00:36:26.218ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2202025-03-08T00:36:26.219ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2212025-03-08T00:36:26.219ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:423
2222025-03-08T00:36:26.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2232025-03-08T00:36:26.219ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2242025-03-08T00:36:26.219ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2252025-03-08T00:36:26.219ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2262025-03-08T00:36:26.219ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2272025-03-08T00:36:26.219ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
2282025-03-08T00:36:26.219ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:51726
2292025-03-08T00:36:26.438ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2302025-03-08T00:36:26.438ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2312025-03-08T00:36:26.444ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4343 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2322025-03-08T00:36:26.444ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4359
2332025-03-08T00:36:26.444ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2342025-03-08T00:36:26.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2352025-03-08T00:36:26.643ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2362025-03-08T00:36:26.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2372025-03-08T00:36:26.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51901
2382025-03-08T00:36:26.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2392025-03-08T00:36:26.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2402025-03-08T00:36:26.671ZINFOSledAgent (ServiceManager): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:186
2412025-03-08T00:36:26.671ZINFOSledAgent (ServiceManager): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:186
2422025-03-08T00:36:26.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51901 req_id = c97e919d-faed-40c6-8fdc-5936a753ddc6 response_code = 200 uri = /inventory
2432025-03-08T00:36:26.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46042
2442025-03-08T00:36:26.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46042 req_id = 40614914-6c16-42ca-943b-3099f7dc061a response_code = 200 uri = /sled-role
2452025-03-08T00:36:26.731ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0bfa42a0-f2a3-4a7e-9405-5756f5480ff5 (physical_disk), pool_id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1959282e-00de-4a65-a7aa-9447002acfac (physical_disk), pool_id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 68ff41d7-ef81-44cf-9521-1e26f79adfc2 (physical_disk), pool_id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 74a79fbd-667a-4691-adaa-b6388f445634 (physical_disk), pool_id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 78928320-2c5e-49e9-86b9-c4b374609919 (physical_disk), pool_id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 95a3a7b3-efc4-4c64-ba19-159bc1e0ba24 (physical_disk), pool_id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 99df82e4-d4d9-47ae-a87d-39938c3ca416 (physical_disk), pool_id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ba260985-31d0-45e5-8634-34f46c9aa878 (physical_disk), pool_id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: fc77017a-3edb-4d9e-8d46-d868886b1868 (physical_disk), pool_id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:399 sled_address = [fd00:1122:3344:101::1]:12345
2462025-03-08T00:36:26.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39184
2472025-03-08T00:36:26.731ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2482025-03-08T00:36:26.731ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0bfa42a0-f2a3-4a7e-9405-5756f5480ff5 (physical_disk), pool_id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 1959282e-00de-4a65-a7aa-9447002acfac (physical_disk), pool_id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 68ff41d7-ef81-44cf-9521-1e26f79adfc2 (physical_disk), pool_id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 74a79fbd-667a-4691-adaa-b6388f445634 (physical_disk), pool_id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 78928320-2c5e-49e9-86b9-c4b374609919 (physical_disk), pool_id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 95a3a7b3-efc4-4c64-ba19-159bc1e0ba24 (physical_disk), pool_id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 99df82e4-d4d9-47ae-a87d-39938c3ca416 (physical_disk), pool_id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ba260985-31d0-45e5-8634-34f46c9aa878 (physical_disk), pool_id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: fc77017a-3edb-4d9e-8d46-d868886b1868 (physical_disk), pool_id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2492025-03-08T00:36:26.731ZINFOSledAgent (StorageManager): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2502025-03-08T00:36:26.731ZINFOSledAgent (StorageManager): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2512025-03-08T00:36:26.731ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1301 request = omicron_physical_disks_ensure
2522025-03-08T00:36:26.731ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2532025-03-08T00:36:26.731ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2542025-03-08T00:36:26.731ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2552025-03-08T00:36:26.731ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2562025-03-08T00:36:26.742ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2572025-03-08T00:36:26.742ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool)
2582025-03-08T00:36:26.858ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }
2592025-03-08T00:36:26.866ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2602025-03-08T00:36:26.866ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2612025-03-08T00:36:26.866ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2622025-03-08T00:36:26.866ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2632025-03-08T00:36:26.866ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2642025-03-08T00:36:26.867ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2652025-03-08T00:36:26.867ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2662025-03-08T00:36:26.910ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2672025-03-08T00:36:26.918ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/zone file = sled-storage/src/dataset.rs:304
2682025-03-08T00:36:27.090ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 file = sled-storage/src/dataset.rs:390
2692025-03-08T00:36:27.098ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2702025-03-08T00:36:27.098ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2712025-03-08T00:36:27.099ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2722025-03-08T00:36:27.099ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2732025-03-08T00:36:27.099ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2742025-03-08T00:36:27.109ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2752025-03-08T00:36:27.109ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool)
2762025-03-08T00:36:27.223ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }
2772025-03-08T00:36:27.230ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2782025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2792025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2802025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2812025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2822025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2832025-03-08T00:36:27.231ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2842025-03-08T00:36:27.274ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2852025-03-08T00:36:27.278ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
2862025-03-08T00:36:27.283ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone file = sled-storage/src/dataset.rs:304
2872025-03-08T00:36:27.451ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2 file = sled-storage/src/dataset.rs:390
2882025-03-08T00:36:27.459ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2892025-03-08T00:36:27.459ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2902025-03-08T00:36:27.459ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2912025-03-08T00:36:27.459ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922025-03-08T00:36:27.459ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2932025-03-08T00:36:27.468ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2942025-03-08T00:36:27.468ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = d5631626-73be-43f2-9e4f-e36e76615c9c (zpool)
2952025-03-08T00:36:27.582ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }
2962025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
2972025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
2982025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
2992025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3002025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3012025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3022025-03-08T00:36:27.590ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3032025-03-08T00:36:27.632ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3042025-03-08T00:36:27.641ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone file = sled-storage/src/dataset.rs:304
3052025-03-08T00:36:27.810ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d5631626-73be-43f2-9e4f-e36e76615c9c file = sled-storage/src/dataset.rs:390
3062025-03-08T00:36:27.818ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3072025-03-08T00:36:27.818ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3082025-03-08T00:36:27.818ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3092025-03-08T00:36:27.818ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3102025-03-08T00:36:27.818ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3112025-03-08T00:36:27.828ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3122025-03-08T00:36:27.828ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = e0013c1d-d815-4e4b-be96-32eb68284438 (zpool)
3132025-03-08T00:36:27.946ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }
3142025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3152025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3162025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3172025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3182025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3192025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3202025-03-08T00:36:27.954ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3212025-03-08T00:36:27.996ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3222025-03-08T00:36:28.004ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone file = sled-storage/src/dataset.rs:304
3232025-03-08T00:36:28.176ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e0013c1d-d815-4e4b-be96-32eb68284438 file = sled-storage/src/dataset.rs:390
3242025-03-08T00:36:28.184ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3252025-03-08T00:36:28.184ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3262025-03-08T00:36:28.184ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3272025-03-08T00:36:28.184ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3282025-03-08T00:36:28.184ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3292025-03-08T00:36:28.194ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3302025-03-08T00:36:28.194ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool)
3312025-03-08T00:36:28.307ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }
3322025-03-08T00:36:28.315ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3332025-03-08T00:36:28.315ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3342025-03-08T00:36:28.316ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3352025-03-08T00:36:28.316ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3362025-03-08T00:36:28.316ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3372025-03-08T00:36:28.316ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3382025-03-08T00:36:28.316ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3392025-03-08T00:36:28.320ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
3402025-03-08T00:36:28.358ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3412025-03-08T00:36:28.366ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone file = sled-storage/src/dataset.rs:304
3422025-03-08T00:36:28.533ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5 file = sled-storage/src/dataset.rs:390
3432025-03-08T00:36:28.541ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3442025-03-08T00:36:28.541ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3452025-03-08T00:36:28.541ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3462025-03-08T00:36:28.541ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3472025-03-08T00:36:28.541ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3482025-03-08T00:36:28.551ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3492025-03-08T00:36:28.551ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool)
3502025-03-08T00:36:28.661ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }
3512025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3522025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3532025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3542025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3552025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3562025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3572025-03-08T00:36:28.669ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3582025-03-08T00:36:28.709ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3592025-03-08T00:36:28.716ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone file = sled-storage/src/dataset.rs:304
3602025-03-08T00:36:28.879ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4 file = sled-storage/src/dataset.rs:390
3612025-03-08T00:36:28.888ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3622025-03-08T00:36:28.888ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3632025-03-08T00:36:28.888ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3642025-03-08T00:36:28.888ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3652025-03-08T00:36:28.888ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3662025-03-08T00:36:28.897ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3672025-03-08T00:36:28.897ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool)
3682025-03-08T00:36:29.006ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }
3692025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3702025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3712025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3722025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3732025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3742025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3752025-03-08T00:36:29.013ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3762025-03-08T00:36:29.056ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3772025-03-08T00:36:29.064ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone file = sled-storage/src/dataset.rs:304
3782025-03-08T00:36:29.245ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159 file = sled-storage/src/dataset.rs:390
3792025-03-08T00:36:29.253ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3802025-03-08T00:36:29.253ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3812025-03-08T00:36:29.253ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3822025-03-08T00:36:29.253ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3832025-03-08T00:36:29.253ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3842025-03-08T00:36:29.264ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3852025-03-08T00:36:29.264ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool)
3862025-03-08T00:36:29.373ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }
3872025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3882025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3892025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3902025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3912025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3922025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3932025-03-08T00:36:29.381ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3942025-03-08T00:36:29.384ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
3952025-03-08T00:36:29.425ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3962025-03-08T00:36:29.434ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone file = sled-storage/src/dataset.rs:304
3972025-03-08T00:36:29.604ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08 file = sled-storage/src/dataset.rs:390
3982025-03-08T00:36:29.612ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
3992025-03-08T00:36:29.612ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4002025-03-08T00:36:29.612ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4012025-03-08T00:36:29.612ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4022025-03-08T00:36:29.612ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4032025-03-08T00:36:29.622ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4042025-03-08T00:36:29.622ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool)
4052025-03-08T00:36:29.738ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }
4062025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4072025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4082025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4092025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4102025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4122025-03-08T00:36:29.747ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4132025-03-08T00:36:29.789ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4142025-03-08T00:36:29.798ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone file = sled-storage/src/dataset.rs:304
4152025-03-08T00:36:29.971ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0def2502-81eb-4b14-9f26-5ae960188d32 file = sled-storage/src/dataset.rs:390
4162025-03-08T00:36:29.979ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4172025-03-08T00:36:29.979ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4182025-03-08T00:36:29.979ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4192025-03-08T00:36:29.979ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 522901ce-0715-43a8-8d70-a8fac8d50c94 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 450bd53e-d8ef-41a8-8d61-35c259ce6831 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4202025-03-08T00:36:29.979ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4212025-03-08T00:36:29.979ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4222025-03-08T00:36:29.980ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4232025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4242025-03-08T00:36:29.980ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4252025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4262025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4272025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4282025-03-08T00:36:29.980ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4292025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4302025-03-08T00:36:29.980ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4312025-03-08T00:36:29.980ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4322025-03-08T00:36:29.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3248928 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39184 req_id = 0aa93333-0b02-424e-945f-e334c2f3621f response_code = 200 uri = /omicron-physical-disks
4332025-03-08T00:36:30.011ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {047c4173-8710-4645-b822-76ab99890870 (dataset): DatasetConfig { id: 047c4173-8710-4645-b822-76ab99890870 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e2ec29e-0861-4612-8392-4cb4dc3c5d2a (dataset): DatasetConfig { id: 0e2ec29e-0861-4612-8392-4cb4dc3c5d2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12d1a8aa-b022-4b79-b4f4-57b68fcf4ad8 (dataset): DatasetConfig { id: 12d1a8aa-b022-4b79-b4f4-57b68fcf4ad8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15e96f7e-3a27-4518-89d1-1e99015fafc6 (dataset): DatasetConfig { id: 15e96f7e-3a27-4518-89d1-1e99015fafc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15eae681-cded-4e9a-86cd-324508506ae4 (dataset): DatasetConfig { id: 15eae681-cded-4e9a-86cd-324508506ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1722b865-bb2a-4e29-9efe-9d421a3c510e (dataset): DatasetConfig { id: 1722b865-bb2a-4e29-9efe-9d421a3c510e (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c91c07-c661-4002-9443-2510bc76649a (dataset): DatasetConfig { id: 18c91c07-c661-4002-9443-2510bc76649a (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19078f78-228d-4962-9bfc-5c9057927105 (dataset): DatasetConfig { id: 19078f78-228d-4962-9bfc-5c9057927105 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 22fd7653-e510-440e-a8da-71e9ef28c1c6 (dataset): DatasetConfig { id: 22fd7653-e510-440e-a8da-71e9ef28c1c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d998d6f-5ac5-426b-aab9-6f2deaab24b4 (dataset): DatasetConfig { id: 2d998d6f-5ac5-426b-aab9-6f2deaab24b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ff9ef78-040c-47d8-bf6b-0e66f42cb61e (dataset): DatasetConfig { id: 2ff9ef78-040c-47d8-bf6b-0e66f42cb61e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 348bc82d-211f-4e5d-9c73-511552b4ecc8 (dataset): DatasetConfig { id: 348bc82d-211f-4e5d-9c73-511552b4ecc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 36db1acf-a8bf-439f-b45c-cf3e94ddcfff (dataset): DatasetConfig { id: 36db1acf-a8bf-439f-b45c-cf3e94ddcfff (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36e07d4d-20c8-4b91-9acc-c3e5f45bb321 (dataset): DatasetConfig { id: 36e07d4d-20c8-4b91-9acc-c3e5f45bb321 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f837522-e2b2-4d64-a4ba-215a6c1df14e (dataset): DatasetConfig { id: 3f837522-e2b2-4d64-a4ba-215a6c1df14e (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42bdbb20-9fe8-4eda-9fdf-1013830aa6b7 (dataset): DatasetConfig { id: 42bdbb20-9fe8-4eda-9fdf-1013830aa6b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 466fb7cf-ca6f-4161-9c80-a18db11aba80 (dataset): DatasetConfig { id: 466fb7cf-ca6f-4161-9c80-a18db11aba80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d8b6c57-c82e-450c-8cd5-13a5d755d94a (dataset): DatasetConfig { id: 4d8b6c57-c82e-450c-8cd5-13a5d755d94a (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e53857e-6841-4bb7-8f3b-29c063996812 (dataset): DatasetConfig { id: 4e53857e-6841-4bb7-8f3b-29c063996812 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51cab391-21d0-4dd8-9faa-8637d401e010 (dataset): DatasetConfig { id: 51cab391-21d0-4dd8-9faa-8637d401e010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cd019e6-44d9-4b61-9b4d-0d31076e2e5f (dataset): DatasetConfig { id: 5cd019e6-44d9-4b61-9b4d-0d31076e2e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f177d9a-3655-4ab0-bdc0-6b6234b01f12 (dataset): DatasetConfig { id: 5f177d9a-3655-4ab0-bdc0-6b6234b01f12 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60494bcc-3476-4715-ab27-f6cc6172de9b (dataset): DatasetConfig { id: 60494bcc-3476-4715-ab27-f6cc6172de9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 621a8f26-b23f-457b-a9a4-4605378918b8 (dataset): DatasetConfig { id: 621a8f26-b23f-457b-a9a4-4605378918b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66824944-d6c9-472d-be16-e0bd69ed8202 (dataset): DatasetConfig { id: 66824944-d6c9-472d-be16-e0bd69ed8202 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 680c35ef-92f9-4c9c-9c92-49e85de5563d (dataset): DatasetConfig { id: 680c35ef-92f9-4c9c-9c92-49e85de5563d (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d6ccb41-7ef3-49fe-a8f3-1e889dacf5de (dataset): DatasetConfig { id: 6d6ccb41-7ef3-49fe-a8f3-1e889dacf5de (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e0b6c8c-3596-4888-a689-41a4ed3748d0 (dataset): DatasetConfig { id: 6e0b6c8c-3596-4888-a689-41a4ed3748d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e44f5d7-e8a6-41c3-a0cc-ac328bff91a3 (dataset): DatasetConfig { id: 6e44f5d7-e8a6-41c3-a0cc-ac328bff91a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70426111-561f-406a-9591-9bd1adab6f5d (dataset): DatasetConfig { id: 70426111-561f-406a-9591-9bd1adab6f5d (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70b9cd3d-98de-4c60-9926-c342a01c8c3a (dataset): DatasetConfig { id: 70b9cd3d-98de-4c60-9926-c342a01c8c3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70cdc366-8baa-4823-93d4-1308af75be87 (dataset): DatasetConfig { id: 70cdc366-8baa-4823-93d4-1308af75be87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70d50147-4648-4392-baa4-dbf61353a6f6 (dataset): DatasetConfig { id: 70d50147-4648-4392-baa4-dbf61353a6f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72be31a1-d749-4e50-9603-7cd9a248c59b (dataset): DatasetConfig { id: 72be31a1-d749-4e50-9603-7cd9a248c59b (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7611ff4b-7d54-4d99-b97d-1dac716a2347 (dataset): DatasetConfig { id: 7611ff4b-7d54-4d99-b97d-1dac716a2347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 786ba8b4-5b16-4880-a2ed-d1484239b5fd (dataset): DatasetConfig { id: 786ba8b4-5b16-4880-a2ed-d1484239b5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80e3ddb6-f2bb-424e-b742-9c025e7022e3 (dataset): DatasetConfig { id: 80e3ddb6-f2bb-424e-b742-9c025e7022e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89943c49-43d5-47d3-88cf-263bc1c7c8cc (dataset): DatasetConfig { id: 89943c49-43d5-47d3-88cf-263bc1c7c8cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c3e9090-193a-4d61-b4b6-8d5e9a2917eb (dataset): DatasetConfig { id: 8c3e9090-193a-4d61-b4b6-8d5e9a2917eb (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9174baa2-e538-465d-934f-7055edb0050b (dataset): DatasetConfig { id: 9174baa2-e538-465d-934f-7055edb0050b (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 918b6936-0cf5-494a-828d-2388e9f636f7 (dataset): DatasetConfig { id: 918b6936-0cf5-494a-828d-2388e9f636f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a8e96d0-b076-4852-8c2e-cc3bad2e586f (dataset): DatasetConfig { id: 9a8e96d0-b076-4852-8c2e-cc3bad2e586f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9aff5d62-08fc-4766-931a-52ce8ac17042 (dataset): DatasetConfig { id: 9aff5d62-08fc-4766-931a-52ce8ac17042 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c4bc4ff-14ed-4d2d-bf10-b193d684eda2 (dataset): DatasetConfig { id: 9c4bc4ff-14ed-4d2d-bf10-b193d684eda2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5038295-a981-403b-b85b-6730a59360f9 (dataset): DatasetConfig { id: a5038295-a981-403b-b85b-6730a59360f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a83d2778-8d9b-4f31-80d2-5a0188317221 (dataset): DatasetConfig { id: a83d2778-8d9b-4f31-80d2-5a0188317221 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aabf8b47-042c-4338-9ad7-eac1963b39ba (dataset): DatasetConfig { id: aabf8b47-042c-4338-9ad7-eac1963b39ba (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad0eff63-04b7-42ab-9e57-91d37ad0ed77 (dataset): DatasetConfig { id: ad0eff63-04b7-42ab-9e57-91d37ad0ed77 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b20e3158-cc91-46b8-8c9c-f6710e563f57 (dataset): DatasetConfig { id: b20e3158-cc91-46b8-8c9c-f6710e563f57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b60ef08b-2453-4c76-8a6b-59fccb600b58 (dataset): DatasetConfig { id: b60ef08b-2453-4c76-8a6b-59fccb600b58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8e0a1b2-cad4-4962-902f-9ae10045cd21 (dataset): DatasetConfig { id: b8e0a1b2-cad4-4962-902f-9ae10045cd21 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb3bfc27-eace-4891-82cd-ae638b223dc1 (dataset): DatasetConfig { id: bb3bfc27-eace-4891-82cd-ae638b223dc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb8adb89-3e50-4bfd-8950-3d13d1bc59f0 (dataset): DatasetConfig { id: bb8adb89-3e50-4bfd-8950-3d13d1bc59f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbcaac33-bcf2-4b44-80a8-8c28fb15af52 (dataset): DatasetConfig { id: bbcaac33-bcf2-4b44-80a8-8c28fb15af52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd19576f-49a1-44fb-b9fb-4b8735c52804 (dataset): DatasetConfig { id: bd19576f-49a1-44fb-b9fb-4b8735c52804 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1777416-090e-45c3-9fa2-c0f17af62fa8 (dataset): DatasetConfig { id: c1777416-090e-45c3-9fa2-c0f17af62fa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb0b271b-890c-4581-8d05-f2cf0a198cdb (dataset): DatasetConfig { id: cb0b271b-890c-4581-8d05-f2cf0a198cdb (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc8d45b4-70f1-4e00-bc2d-9c39e3640401 (dataset): DatasetConfig { id: cc8d45b4-70f1-4e00-bc2d-9c39e3640401 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1fd75c5-7a1c-4d84-937a-2fed997ec899 (dataset): DatasetConfig { id: d1fd75c5-7a1c-4d84-937a-2fed997ec899 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8907598-4f99-4e64-8c45-c772e7a33e77 (dataset): DatasetConfig { id: d8907598-4f99-4e64-8c45-c772e7a33e77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da1c473a-e28c-4597-8885-112bbdd97b43 (dataset): DatasetConfig { id: da1c473a-e28c-4597-8885-112bbdd97b43 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dac868cd-d1f9-4f2c-b7e8-8bd7810b0193 (dataset): DatasetConfig { id: dac868cd-d1f9-4f2c-b7e8-8bd7810b0193 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e27822b4-ffbf-4739-a180-3a07a5c0236f (dataset): DatasetConfig { id: e27822b4-ffbf-4739-a180-3a07a5c0236f (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5bb2386-90f3-4cdc-8710-c7cb83ab595d (dataset): DatasetConfig { id: e5bb2386-90f3-4cdc-8710-c7cb83ab595d (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efa3e2dc-13d7-41eb-af41-143e91724bb7 (dataset): DatasetConfig { id: efa3e2dc-13d7-41eb-af41-143e91724bb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff4a315a-4bcd-43b0-bd26-c5d9ebafe1d8 (dataset): DatasetConfig { id: ff4a315a-4bcd-43b0-bd26-c5d9ebafe1d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:527 sled_address = [fd00:1122:3344:101::1]:12345
4342025-03-08T00:36:30.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61666
4352025-03-08T00:36:30.012ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4362025-03-08T00:36:30.012ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {047c4173-8710-4645-b822-76ab99890870 (dataset): DatasetConfig { id: 047c4173-8710-4645-b822-76ab99890870 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e2ec29e-0861-4612-8392-4cb4dc3c5d2a (dataset): DatasetConfig { id: 0e2ec29e-0861-4612-8392-4cb4dc3c5d2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12d1a8aa-b022-4b79-b4f4-57b68fcf4ad8 (dataset): DatasetConfig { id: 12d1a8aa-b022-4b79-b4f4-57b68fcf4ad8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15e96f7e-3a27-4518-89d1-1e99015fafc6 (dataset): DatasetConfig { id: 15e96f7e-3a27-4518-89d1-1e99015fafc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15eae681-cded-4e9a-86cd-324508506ae4 (dataset): DatasetConfig { id: 15eae681-cded-4e9a-86cd-324508506ae4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1722b865-bb2a-4e29-9efe-9d421a3c510e (dataset): DatasetConfig { id: 1722b865-bb2a-4e29-9efe-9d421a3c510e (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c91c07-c661-4002-9443-2510bc76649a (dataset): DatasetConfig { id: 18c91c07-c661-4002-9443-2510bc76649a (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19078f78-228d-4962-9bfc-5c9057927105 (dataset): DatasetConfig { id: 19078f78-228d-4962-9bfc-5c9057927105 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 22fd7653-e510-440e-a8da-71e9ef28c1c6 (dataset): DatasetConfig { id: 22fd7653-e510-440e-a8da-71e9ef28c1c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2d998d6f-5ac5-426b-aab9-6f2deaab24b4 (dataset): DatasetConfig { id: 2d998d6f-5ac5-426b-aab9-6f2deaab24b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ff9ef78-040c-47d8-bf6b-0e66f42cb61e (dataset): DatasetConfig { id: 2ff9ef78-040c-47d8-bf6b-0e66f42cb61e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 348bc82d-211f-4e5d-9c73-511552b4ecc8 (dataset): DatasetConfig { id: 348bc82d-211f-4e5d-9c73-511552b4ecc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 36db1acf-a8bf-439f-b45c-cf3e94ddcfff (dataset): DatasetConfig { id: 36db1acf-a8bf-439f-b45c-cf3e94ddcfff (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36e07d4d-20c8-4b91-9acc-c3e5f45bb321 (dataset): DatasetConfig { id: 36e07d4d-20c8-4b91-9acc-c3e5f45bb321 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f837522-e2b2-4d64-a4ba-215a6c1df14e (dataset): DatasetConfig { id: 3f837522-e2b2-4d64-a4ba-215a6c1df14e (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42bdbb20-9fe8-4eda-9fdf-1013830aa6b7 (dataset): DatasetConfig { id: 42bdbb20-9fe8-4eda-9fdf-1013830aa6b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 466fb7cf-ca6f-4161-9c80-a18db11aba80 (dataset): DatasetConfig { id: 466fb7cf-ca6f-4161-9c80-a18db11aba80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d8b6c57-c82e-450c-8cd5-13a5d755d94a (dataset): DatasetConfig { id: 4d8b6c57-c82e-450c-8cd5-13a5d755d94a (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e53857e-6841-4bb7-8f3b-29c063996812 (dataset): DatasetConfig { id: 4e53857e-6841-4bb7-8f3b-29c063996812 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51cab391-21d0-4dd8-9faa-8637d401e010 (dataset): DatasetConfig { id: 51cab391-21d0-4dd8-9faa-8637d401e010 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cd019e6-44d9-4b61-9b4d-0d31076e2e5f (dataset): DatasetConfig { id: 5cd019e6-44d9-4b61-9b4d-0d31076e2e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f177d9a-3655-4ab0-bdc0-6b6234b01f12 (dataset): DatasetConfig { id: 5f177d9a-3655-4ab0-bdc0-6b6234b01f12 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60494bcc-3476-4715-ab27-f6cc6172de9b (dataset): DatasetConfig { id: 60494bcc-3476-4715-ab27-f6cc6172de9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 621a8f26-b23f-457b-a9a4-4605378918b8 (dataset): DatasetConfig { id: 621a8f26-b23f-457b-a9a4-4605378918b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66824944-d6c9-472d-be16-e0bd69ed8202 (dataset): DatasetConfig { id: 66824944-d6c9-472d-be16-e0bd69ed8202 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 680c35ef-92f9-4c9c-9c92-49e85de5563d (dataset): DatasetConfig { id: 680c35ef-92f9-4c9c-9c92-49e85de5563d (dataset), name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d6ccb41-7ef3-49fe-a8f3-1e889dacf5de (dataset): DatasetConfig { id: 6d6ccb41-7ef3-49fe-a8f3-1e889dacf5de (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e0b6c8c-3596-4888-a689-41a4ed3748d0 (dataset): DatasetConfig { id: 6e0b6c8c-3596-4888-a689-41a4ed3748d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e44f5d7-e8a6-41c3-a0cc-ac328bff91a3 (dataset): DatasetConfig { id: 6e44f5d7-e8a6-41c3-a0cc-ac328bff91a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70426111-561f-406a-9591-9bd1adab6f5d (dataset): DatasetConfig { id: 70426111-561f-406a-9591-9bd1adab6f5d (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70b9cd3d-98de-4c60-9926-c342a01c8c3a (dataset): DatasetConfig { id: 70b9cd3d-98de-4c60-9926-c342a01c8c3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 70cdc366-8baa-4823-93d4-1308af75be87 (dataset): DatasetConfig { id: 70cdc366-8baa-4823-93d4-1308af75be87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70d50147-4648-4392-baa4-dbf61353a6f6 (dataset): DatasetConfig { id: 70d50147-4648-4392-baa4-dbf61353a6f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72be31a1-d749-4e50-9603-7cd9a248c59b (dataset): DatasetConfig { id: 72be31a1-d749-4e50-9603-7cd9a248c59b (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7611ff4b-7d54-4d99-b97d-1dac716a2347 (dataset): DatasetConfig { id: 7611ff4b-7d54-4d99-b97d-1dac716a2347 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 786ba8b4-5b16-4880-a2ed-d1484239b5fd (dataset): DatasetConfig { id: 786ba8b4-5b16-4880-a2ed-d1484239b5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80e3ddb6-f2bb-424e-b742-9c025e7022e3 (dataset): DatasetConfig { id: 80e3ddb6-f2bb-424e-b742-9c025e7022e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89943c49-43d5-47d3-88cf-263bc1c7c8cc (dataset): DatasetConfig { id: 89943c49-43d5-47d3-88cf-263bc1c7c8cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c3e9090-193a-4d61-b4b6-8d5e9a2917eb (dataset): DatasetConfig { id: 8c3e9090-193a-4d61-b4b6-8d5e9a2917eb (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9174baa2-e538-465d-934f-7055edb0050b (dataset): DatasetConfig { id: 9174baa2-e538-465d-934f-7055edb0050b (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 918b6936-0cf5-494a-828d-2388e9f636f7 (dataset): DatasetConfig { id: 918b6936-0cf5-494a-828d-2388e9f636f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a8e96d0-b076-4852-8c2e-cc3bad2e586f (dataset): DatasetConfig { id: 9a8e96d0-b076-4852-8c2e-cc3bad2e586f (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9aff5d62-08fc-4766-931a-52ce8ac17042 (dataset): DatasetConfig { id: 9aff5d62-08fc-4766-931a-52ce8ac17042 (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c4bc4ff-14ed-4d2d-bf10-b193d684eda2 (dataset): DatasetConfig { id: 9c4bc4ff-14ed-4d2d-bf10-b193d684eda2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5038295-a981-403b-b85b-6730a59360f9 (dataset): DatasetConfig { id: a5038295-a981-403b-b85b-6730a59360f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a83d2778-8d9b-4f31-80d2-5a0188317221 (dataset): DatasetConfig { id: a83d2778-8d9b-4f31-80d2-5a0188317221 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aabf8b47-042c-4338-9ad7-eac1963b39ba (dataset): DatasetConfig { id: aabf8b47-042c-4338-9ad7-eac1963b39ba (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad0eff63-04b7-42ab-9e57-91d37ad0ed77 (dataset): DatasetConfig { id: ad0eff63-04b7-42ab-9e57-91d37ad0ed77 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b20e3158-cc91-46b8-8c9c-f6710e563f57 (dataset): DatasetConfig { id: b20e3158-cc91-46b8-8c9c-f6710e563f57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b60ef08b-2453-4c76-8a6b-59fccb600b58 (dataset): DatasetConfig { id: b60ef08b-2453-4c76-8a6b-59fccb600b58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8e0a1b2-cad4-4962-902f-9ae10045cd21 (dataset): DatasetConfig { id: b8e0a1b2-cad4-4962-902f-9ae10045cd21 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb3bfc27-eace-4891-82cd-ae638b223dc1 (dataset): DatasetConfig { id: bb3bfc27-eace-4891-82cd-ae638b223dc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb8adb89-3e50-4bfd-8950-3d13d1bc59f0 (dataset): DatasetConfig { id: bb8adb89-3e50-4bfd-8950-3d13d1bc59f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbcaac33-bcf2-4b44-80a8-8c28fb15af52 (dataset): DatasetConfig { id: bbcaac33-bcf2-4b44-80a8-8c28fb15af52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd19576f-49a1-44fb-b9fb-4b8735c52804 (dataset): DatasetConfig { id: bd19576f-49a1-44fb-b9fb-4b8735c52804 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1777416-090e-45c3-9fa2-c0f17af62fa8 (dataset): DatasetConfig { id: c1777416-090e-45c3-9fa2-c0f17af62fa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cb0b271b-890c-4581-8d05-f2cf0a198cdb (dataset): DatasetConfig { id: cb0b271b-890c-4581-8d05-f2cf0a198cdb (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc8d45b4-70f1-4e00-bc2d-9c39e3640401 (dataset): DatasetConfig { id: cc8d45b4-70f1-4e00-bc2d-9c39e3640401 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1fd75c5-7a1c-4d84-937a-2fed997ec899 (dataset): DatasetConfig { id: d1fd75c5-7a1c-4d84-937a-2fed997ec899 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8907598-4f99-4e64-8c45-c772e7a33e77 (dataset): DatasetConfig { id: d8907598-4f99-4e64-8c45-c772e7a33e77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da1c473a-e28c-4597-8885-112bbdd97b43 (dataset): DatasetConfig { id: da1c473a-e28c-4597-8885-112bbdd97b43 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dac868cd-d1f9-4f2c-b7e8-8bd7810b0193 (dataset): DatasetConfig { id: dac868cd-d1f9-4f2c-b7e8-8bd7810b0193 (dataset), name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e27822b4-ffbf-4739-a180-3a07a5c0236f (dataset): DatasetConfig { id: e27822b4-ffbf-4739-a180-3a07a5c0236f (dataset), name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5bb2386-90f3-4cdc-8710-c7cb83ab595d (dataset): DatasetConfig { id: e5bb2386-90f3-4cdc-8710-c7cb83ab595d (dataset), name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efa3e2dc-13d7-41eb-af41-143e91724bb7 (dataset): DatasetConfig { id: efa3e2dc-13d7-41eb-af41-143e91724bb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff4a315a-4bcd-43b0-bd26-c5d9ebafe1d8 (dataset): DatasetConfig { id: ff4a315a-4bcd-43b0-bd26-c5d9ebafe1d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4372025-03-08T00:36:30.012ZINFOSledAgent (StorageManager): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4382025-03-08T00:36:30.012ZINFOSledAgent (StorageManager): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-08T00:36:30.012ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4402025-03-08T00:36:30.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4412025-03-08T00:36:30.027ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4422025-03-08T00:36:30.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone" } file = sled-storage/src/manager.rs:1433
4432025-03-08T00:36:30.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4442025-03-08T00:36:30.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4452025-03-08T00:36:30.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1" } file = sled-storage/src/manager.rs:1433
4462025-03-08T00:36:30.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4472025-03-08T00:36:30.139ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4482025-03-08T00:36:30.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c" } file = sled-storage/src/manager.rs:1433
4492025-03-08T00:36:30.207ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4502025-03-08T00:36:30.207ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4512025-03-08T00:36:30.207ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/debug"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/debug" } file = sled-storage/src/manager.rs:1433
4522025-03-08T00:36:30.240ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4532025-03-08T00:36:30.240ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4542025-03-08T00:36:30.240ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone/oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone/oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d" } file = sled-storage/src/manager.rs:1433
4552025-03-08T00:36:30.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4562025-03-08T00:36:30.312ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4572025-03-08T00:36:30.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/clickhouse" } file = sled-storage/src/manager.rs:1433
4582025-03-08T00:36:30.374ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4592025-03-08T00:36:30.374ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4602025-03-08T00:36:30.374ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684" } file = sled-storage/src/manager.rs:1433
4612025-03-08T00:36:30.386ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
4622025-03-08T00:36:30.448ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4632025-03-08T00:36:30.448ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4642025-03-08T00:36:30.448ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/debug"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/debug" } file = sled-storage/src/manager.rs:1433
4652025-03-08T00:36:30.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4662025-03-08T00:36:30.484ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4672025-03-08T00:36:30.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/debug"), full_name: "oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/debug" } file = sled-storage/src/manager.rs:1433
4682025-03-08T00:36:30.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4692025-03-08T00:36:30.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4702025-03-08T00:36:30.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4712025-03-08T00:36:30.589ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4722025-03-08T00:36:30.589ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4732025-03-08T00:36:30.589ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d" } file = sled-storage/src/manager.rs:1433
4742025-03-08T00:36:30.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4752025-03-08T00:36:30.658ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4762025-03-08T00:36:30.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/debug"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/debug" } file = sled-storage/src/manager.rs:1433
4772025-03-08T00:36:30.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4782025-03-08T00:36:30.697ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4792025-03-08T00:36:30.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/zone/oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1"), full_name: "oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/zone/oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1" } file = sled-storage/src/manager.rs:1433
4802025-03-08T00:36:30.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4812025-03-08T00:36:30.772ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4822025-03-08T00:36:30.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4832025-03-08T00:36:30.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4842025-03-08T00:36:30.839ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4852025-03-08T00:36:30.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone"), full_name: "oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone" } file = sled-storage/src/manager.rs:1433
4862025-03-08T00:36:30.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-08T00:36:30.878ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4882025-03-08T00:36:30.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crucible" } file = sled-storage/src/manager.rs:1433
4892025-03-08T00:36:30.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-08T00:36:30.942ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4912025-03-08T00:36:30.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone" } file = sled-storage/src/manager.rs:1433
4922025-03-08T00:36:30.981ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-08T00:36:30.981ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4942025-03-08T00:36:30.981ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/debug"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/debug" } file = sled-storage/src/manager.rs:1433
4952025-03-08T00:36:31.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-08T00:36:31.019ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4972025-03-08T00:36:31.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183" } file = sled-storage/src/manager.rs:1433
4982025-03-08T00:36:31.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4992025-03-08T00:36:31.094ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5002025-03-08T00:36:31.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88" } file = sled-storage/src/manager.rs:1433
5012025-03-08T00:36:31.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5022025-03-08T00:36:31.170ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5032025-03-08T00:36:31.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crucible" } file = sled-storage/src/manager.rs:1433
5042025-03-08T00:36:31.238ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5052025-03-08T00:36:31.238ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5062025-03-08T00:36:31.238ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone"), full_name: "oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone" } file = sled-storage/src/manager.rs:1433
5072025-03-08T00:36:31.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5082025-03-08T00:36:31.277ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5092025-03-08T00:36:31.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/zone/oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949" } file = sled-storage/src/manager.rs:1433
5102025-03-08T00:36:31.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5112025-03-08T00:36:31.353ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5122025-03-08T00:36:31.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5132025-03-08T00:36:31.388ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
5142025-03-08T00:36:31.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5152025-03-08T00:36:31.423ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5162025-03-08T00:36:31.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crucible" } file = sled-storage/src/manager.rs:1433
5172025-03-08T00:36:31.491ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5182025-03-08T00:36:31.491ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5192025-03-08T00:36:31.491ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/zone"), full_name: "oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/zone" } file = sled-storage/src/manager.rs:1433
5202025-03-08T00:36:31.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5212025-03-08T00:36:31.532ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5222025-03-08T00:36:31.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5232025-03-08T00:36:31.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5242025-03-08T00:36:31.595ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5252025-03-08T00:36:31.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5262025-03-08T00:36:31.659ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5272025-03-08T00:36:31.659ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5282025-03-08T00:36:31.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone" } file = sled-storage/src/manager.rs:1433
5292025-03-08T00:36:31.698ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5302025-03-08T00:36:31.698ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5312025-03-08T00:36:31.698ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/debug"), full_name: "oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/debug" } file = sled-storage/src/manager.rs:1433
5322025-03-08T00:36:31.736ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5332025-03-08T00:36:31.736ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5342025-03-08T00:36:31.736ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/debug"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/debug" } file = sled-storage/src/manager.rs:1433
5352025-03-08T00:36:31.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5362025-03-08T00:36:31.778ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5372025-03-08T00:36:31.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5382025-03-08T00:36:31.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5392025-03-08T00:36:31.843ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5402025-03-08T00:36:31.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5412025-03-08T00:36:31.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5422025-03-08T00:36:31.909ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5432025-03-08T00:36:31.909ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0" } file = sled-storage/src/manager.rs:1433
5442025-03-08T00:36:31.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5452025-03-08T00:36:31.994ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5462025-03-08T00:36:31.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone" } file = sled-storage/src/manager.rs:1433
5472025-03-08T00:36:32.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5482025-03-08T00:36:32.043ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5492025-03-08T00:36:32.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone/oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072"), full_name: "oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone/oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072" } file = sled-storage/src/manager.rs:1433
5502025-03-08T00:36:32.129ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5512025-03-08T00:36:32.129ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5522025-03-08T00:36:32.129ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5532025-03-08T00:36:32.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5542025-03-08T00:36:32.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5552025-03-08T00:36:32.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crucible" } file = sled-storage/src/manager.rs:1433
5562025-03-08T00:36:32.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5572025-03-08T00:36:32.255ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5582025-03-08T00:36:32.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crucible" } file = sled-storage/src/manager.rs:1433
5592025-03-08T00:36:32.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5602025-03-08T00:36:32.312ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5612025-03-08T00:36:32.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone/oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec"), full_name: "oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone/oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec" } file = sled-storage/src/manager.rs:1433
5622025-03-08T00:36:32.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5632025-03-08T00:36:32.387ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5642025-03-08T00:36:32.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crucible" } file = sled-storage/src/manager.rs:1433
5652025-03-08T00:36:32.390ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
5662025-03-08T00:36:32.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5672025-03-08T00:36:32.445ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5682025-03-08T00:36:32.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
5692025-03-08T00:36:32.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5702025-03-08T00:36:32.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5712025-03-08T00:36:32.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone/oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b"), full_name: "oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/zone/oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b" } file = sled-storage/src/manager.rs:1433
5722025-03-08T00:36:32.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5732025-03-08T00:36:32.579ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5742025-03-08T00:36:32.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crucible" } file = sled-storage/src/manager.rs:1433
5752025-03-08T00:36:32.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5762025-03-08T00:36:32.649ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5772025-03-08T00:36:32.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98" } file = sled-storage/src/manager.rs:1433
5782025-03-08T00:36:32.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5792025-03-08T00:36:32.722ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5802025-03-08T00:36:32.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone" } file = sled-storage/src/manager.rs:1433
5812025-03-08T00:36:32.761ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5822025-03-08T00:36:32.761ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5832025-03-08T00:36:32.761ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331" } file = sled-storage/src/manager.rs:1433
5842025-03-08T00:36:32.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5852025-03-08T00:36:32.838ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5862025-03-08T00:36:32.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/zone/oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c" } file = sled-storage/src/manager.rs:1433
5872025-03-08T00:36:32.911ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5882025-03-08T00:36:32.911ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5892025-03-08T00:36:32.911ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone/oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), full_name: "oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone/oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f" } file = sled-storage/src/manager.rs:1433
5902025-03-08T00:36:32.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5912025-03-08T00:36:32.990ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5922025-03-08T00:36:32.990ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/debug"), full_name: "oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/debug" } file = sled-storage/src/manager.rs:1433
5932025-03-08T00:36:33.029ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5942025-03-08T00:36:33.029ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5952025-03-08T00:36:33.029ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a" } file = sled-storage/src/manager.rs:1433
5962025-03-08T00:36:33.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5972025-03-08T00:36:33.104ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5982025-03-08T00:36:33.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
5992025-03-08T00:36:33.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6002025-03-08T00:36:33.171ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6012025-03-08T00:36:33.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824" } file = sled-storage/src/manager.rs:1433
6022025-03-08T00:36:33.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6032025-03-08T00:36:33.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6042025-03-08T00:36:33.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8" } file = sled-storage/src/manager.rs:1433
6052025-03-08T00:36:33.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6062025-03-08T00:36:33.323ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6072025-03-08T00:36:33.323ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone/oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1"), full_name: "oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/zone/oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1" } file = sled-storage/src/manager.rs:1433
6082025-03-08T00:36:33.392ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6092025-03-08T00:36:33.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6102025-03-08T00:36:33.399ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6112025-03-08T00:36:33.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible" } file = sled-storage/src/manager.rs:1433
6122025-03-08T00:36:33.462ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6132025-03-08T00:36:33.462ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6142025-03-08T00:36:33.462ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5" } file = sled-storage/src/manager.rs:1433
6152025-03-08T00:36:33.537ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6162025-03-08T00:36:33.537ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6172025-03-08T00:36:33.537ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e" } file = sled-storage/src/manager.rs:1433
6182025-03-08T00:36:33.611ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6192025-03-08T00:36:33.611ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6202025-03-08T00:36:33.611ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737" } file = sled-storage/src/manager.rs:1433
6212025-03-08T00:36:33.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6222025-03-08T00:36:33.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6232025-03-08T00:36:33.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone/oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69"), full_name: "oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/zone/oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69" } file = sled-storage/src/manager.rs:1433
6242025-03-08T00:36:33.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6252025-03-08T00:36:33.763ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6262025-03-08T00:36:33.763ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone"), full_name: "oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone" } file = sled-storage/src/manager.rs:1433
6272025-03-08T00:36:33.801ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6282025-03-08T00:36:33.801ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6292025-03-08T00:36:33.801ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crucible" } file = sled-storage/src/manager.rs:1433
6302025-03-08T00:36:33.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6312025-03-08T00:36:33.864ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6322025-03-08T00:36:33.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/debug"), full_name: "oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/debug" } file = sled-storage/src/manager.rs:1433
6332025-03-08T00:36:33.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6342025-03-08T00:36:33.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6352025-03-08T00:36:33.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a"), full_name: "oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crypt/zone/oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a" } file = sled-storage/src/manager.rs:1433
6362025-03-08T00:36:33.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6372025-03-08T00:36:33.976ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6382025-03-08T00:36:33.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8"), full_name: "oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/zone/oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8" } file = sled-storage/src/manager.rs:1433
6392025-03-08T00:36:34.053ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6402025-03-08T00:36:34.053ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6412025-03-08T00:36:34.053ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone/oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec"), full_name: "oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/zone/oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec" } file = sled-storage/src/manager.rs:1433
6422025-03-08T00:36:34.126ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6432025-03-08T00:36:34.127ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6442025-03-08T00:36:34.127ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6452025-03-08T00:36:34.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4115459 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61666 req_id = 56211e51-953b-4f71-8fdd-aca83b795831 response_code = 200 uri = /datasets
6462025-03-08T00:36:34.159ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 508de01a-93ec-4309-a59e-0cfd22b5027a (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1ac98a83-1243-46f5-99db-fd29222026d8 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7a2ff4e8-6697-4c29-ad00-14a8b25b198c (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
6472025-03-08T00:36:34.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57493
6482025-03-08T00:36:34.159ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6492025-03-08T00:36:34.159ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502025-03-08T00:36:34.168ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6512025-03-08T00:36:34.168ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-03-08T00:36:34.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6532025-03-08T00:36:34.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542025-03-08T00:36:34.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6552025-03-08T00:36:34.187ZINFOSledAgent (ServiceManager): No ledger in /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:186
6562025-03-08T00:36:34.187ZINFOSledAgent (ServiceManager): No ledger in /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:186
6572025-03-08T00:36:34.187ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6582025-03-08T00:36:34.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6592025-03-08T00:36:34.236ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6602025-03-08T00:36:34.236ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-03-08T00:36:34.236ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-03-08T00:36:34.290ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c file = illumos-utils/src/zone.rs:327
6632025-03-08T00:36:34.294ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a file = illumos-utils/src/zone.rs:327
6642025-03-08T00:36:34.298ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8 file = illumos-utils/src/zone.rs:327
6652025-03-08T00:36:34.310ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c file = illumos-utils/src/zone.rs:365
6662025-03-08T00:36:34.315ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a file = illumos-utils/src/zone.rs:365
6672025-03-08T00:36:34.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8 file = illumos-utils/src/zone.rs:365
6682025-03-08T00:36:34.394ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6692025-03-08T00:36:34.909ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 20.468909055s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6702025-03-08T00:36:35.397ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6712025-03-08T00:36:35.816ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4367
6722025-03-08T00:36:35.816ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4377 gateway = fd00:1122:3344:101::1
6732025-03-08T00:36:35.823ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4391 gateway = fd00:1122:3344:101::1
6742025-03-08T00:36:35.823ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4456
6752025-03-08T00:36:35.963ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4497
6762025-03-08T00:36:35.963ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4530
6772025-03-08T00:36:36.000ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4543
6782025-03-08T00:36:36.000ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4408
6792025-03-08T00:36:36.003ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-03-08T00:36:36.057ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4450
6812025-03-08T00:36:36.057ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4507 rack_subnet = fd00:1122:3344::
6822025-03-08T00:36:36.078ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4518
6832025-03-08T00:36:36.078ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4600
6842025-03-08T00:36:36.146ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4632
6852025-03-08T00:36:36.146ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4638
6862025-03-08T00:36:36.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6872025-03-08T00:36:36.192ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6882025-03-08T00:36:36.237ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4679
6892025-03-08T00:36:36.237ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4549
6902025-03-08T00:36:36.322ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4582
6912025-03-08T00:36:36.322ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6922025-03-08T00:36:36.355ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/nexus.rs:530 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
6932025-03-08T00:36:36.355ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6942025-03-08T00:36:36.387ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6952025-03-08T00:36:36.387ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6962025-03-08T00:36:36.387ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6972025-03-08T00:36:36.387ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6982025-03-08T00:36:36.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
6992025-03-08T00:36:36.475ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7002025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7012025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7022025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7032025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7042025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7052025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7062025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7072025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7082025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7092025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7102025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7112025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7122025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7132025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7142025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7152025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7162025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7172025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7182025-03-08T00:36:36.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7192025-03-08T00:36:36.476ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7202025-03-08T00:36:36.476ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7212025-03-08T00:36:36.476ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7222025-03-08T00:36:36.484ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7232025-03-08T00:36:36.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
7242025-03-08T00:36:36.645ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
7252025-03-08T00:36:36.961ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7262025-03-08T00:36:36.961ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7272025-03-08T00:36:36.965ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7282025-03-08T00:36:36.969ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7292025-03-08T00:36:37.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 34.847178ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7302025-03-08T00:36:37.096ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 41.786354ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7312025-03-08T00:36:37.102ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 44.960026ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7322025-03-08T00:36:37.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 55.557785ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7332025-03-08T00:36:37.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 93.125435ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7342025-03-08T00:36:37.165ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 120.005138ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7352025-03-08T00:36:37.281ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 256.711355ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7362025-03-08T00:36:37.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 207.918373ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7372025-03-08T00:36:37.315ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 283.952892ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7382025-03-08T00:36:37.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 314.956411ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7392025-03-08T00:36:37.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 390.030719ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7402025-03-08T00:36:37.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 353.686735ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7412025-03-08T00:36:37.908ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 1.189158594s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7422025-03-08T00:36:38.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 922.082947ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7432025-03-08T00:36:38.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 538.46937ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7442025-03-08T00:36:38.583ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 1.428896774s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7452025-03-08T00:36:38.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 530.854923ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7462025-03-08T00:36:39.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 1.46668022s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7472025-03-08T00:36:39.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 866.522684ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7482025-03-08T00:36:40.021ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 573.745308ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7492025-03-08T00:36:40.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 1.352097461s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7502025-03-08T00:36:40.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 615.888559ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7512025-03-08T00:36:40.603ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 1.304437687s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7522025-03-08T00:36:41.206ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 619.02157ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7532025-03-08T00:36:41.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 809.940171ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7542025-03-08T00:36:41.835ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c") failed: Property not found. retry in 1.491530321s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7552025-03-08T00:36:41.916ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a") failed: Property not found. retry in 907.307013ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7562025-03-08T00:36:42.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8") failed: Property not found. retry in 1.182936651s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7572025-03-08T00:36:43.752ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_7a2ff4e8-6697-4c29-ad00-14a8b25b198c
7582025-03-08T00:36:43.752ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_508de01a-93ec-4309-a59e-0cfd22b5027a
7592025-03-08T00:36:43.752ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_1ac98a83-1243-46f5-99db-fd29222026d8
7602025-03-08T00:36:43.752ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7612025-03-08T00:36:43.752ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
7622025-03-08T00:36:43.752ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7632025-03-08T00:36:43.753ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
7642025-03-08T00:36:43.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9593907 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57493 req_id = 0ed19c57-93bf-4d65-9af7-c8a918100aec response_code = 204 uri = /omicron-zones
7652025-03-08T00:36:43.754ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }} withdrawn = []
7662025-03-08T00:36:43.755ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7672025-03-08T00:36:44.044ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 135.664385ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:745
7682025-03-08T00:36:44.205ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7692025-03-08T00:36:44.268ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7702025-03-08T00:36:44.323ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:761
7712025-03-08T00:36:44.323ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7722025-03-08T00:36:44.355ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7732025-03-08T00:36:44.356ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7742025-03-08T00:36:44.356ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7752025-03-08T00:36:44.385ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 508de01a-93ec-4309-a59e-0cfd22b5027a (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1ac98a83-1243-46f5-99db-fd29222026d8 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7a2ff4e8-6697-4c29-ad00-14a8b25b198c (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bc0e0b9f-0d87-400e-bb99-5f74ae28ea72, kind: Service { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 }, name: Name("ntp-fb5d8045-9a48-4848-a7a5-55a8d8d968c0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
7762025-03-08T00:36:44.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34316
7772025-03-08T00:36:44.386ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-03-08T00:36:44.386ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-03-08T00:36:44.397ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-03-08T00:36:44.397ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-03-08T00:36:44.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-03-08T00:36:44.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-03-08T00:36:44.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-03-08T00:36:44.416ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
7852025-03-08T00:36:44.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
7862025-03-08T00:36:44.417ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7872025-03-08T00:36:44.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882025-03-08T00:36:44.428ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892025-03-08T00:36:44.461ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902025-03-08T00:36:44.462ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912025-03-08T00:36:44.462ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922025-03-08T00:36:44.491ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 137, 247]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932025-03-08T00:36:44.491ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = boundary_ntp
7942025-03-08T00:36:44.492ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7952025-03-08T00:36:44.492ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7962025-03-08T00:36:44.492ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7972025-03-08T00:36:44.492ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982025-03-08T00:36:44.516ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0 file = illumos-utils/src/zone.rs:327
7992025-03-08T00:36:44.536ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0 file = illumos-utils/src/zone.rs:365
8002025-03-08T00:36:45.201ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012025-03-08T00:36:45.201ZINFOSledAgent (ServiceManager): Booting oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8022025-03-08T00:36:45.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 69.312996ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8032025-03-08T00:36:45.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 77.947119ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8042025-03-08T00:36:45.503ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 138.418807ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8052025-03-08T00:36:45.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 348.479461ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8062025-03-08T00:36:46.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 1.130588025s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8072025-03-08T00:36:46.192ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8082025-03-08T00:36:46.193ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8092025-03-08T00:36:46.646ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8102025-03-08T00:36:46.647ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8112025-03-08T00:36:47.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 948.563803ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8122025-03-08T00:36:48.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 1.240700716s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8132025-03-08T00:36:49.359ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0") failed: Property not found. retry in 861.798045ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8142025-03-08T00:36:50.241ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0
8152025-03-08T00:36:50.241ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8162025-03-08T00:36:50.241ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8172025-03-08T00:36:50.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5856356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34316 req_id = 68b7ae1e-138f-43b4-8c3f-5ec7d295fd68 response_code = 204 uri = /omicron-zones
8182025-03-08T00:36:50.244ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:802
8192025-03-08T00:36:50.275ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8202025-03-08T00:36:50.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58643
8212025-03-08T00:36:50.286ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8222025-03-08T00:36:50.286ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 10773 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58643 req_id = fa3e7078-832c-4eb3-b400-696cf69b0cf9 response_code = 500 uri = /timesync
8232025-03-08T00:36:50.288ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8242025-03-08T00:36:50.388ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8252025-03-08T00:36:50.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64001
8262025-03-08T00:36:54.399ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8272025-03-08T00:36:54.399ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4010181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64001 req_id = 7c662280-c804-43a3-8abd-f0267935737d response_code = 500 uri = /timesync
8282025-03-08T00:36:54.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8292025-03-08T00:36:54.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8302025-03-08T00:36:54.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8312025-03-08T00:36:54.403ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8322025-03-08T00:36:54.550ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8332025-03-08T00:36:54.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34170
8342025-03-08T00:36:54.559ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8352025-03-08T00:36:54.559ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 9082 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34170 req_id = 55c6989e-3143-4b8d-a7cf-9c1d3f9e4c9f response_code = 500 uri = /timesync
8362025-03-08T00:36:54.562ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8372025-03-08T00:36:54.694ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8382025-03-08T00:36:54.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38045
8392025-03-08T00:36:56.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8402025-03-08T00:36:56.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8412025-03-08T00:36:56.647ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8422025-03-08T00:36:56.648ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8432025-03-08T00:36:59.418ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fb5d8045-9a48-4848-a7a5-55a8d8d968c0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8442025-03-08T00:36:59.418ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4009419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38045 req_id = 7159df1e-ce48-4e75-95c8-7325e370659c response_code = 500 uri = /timesync
8452025-03-08T00:36:59.420ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8462025-03-08T00:36:59.614ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8472025-03-08T00:36:59.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37481
8482025-03-08T00:36:59.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37481 req_id = 6ffdb827-cc68-41ff-8ec6-74fc6ecd55a7 response_code = 200 uri = /timesync
8492025-03-08T00:36:59.626ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.391304791 } file = sled-agent/src/rack_setup/service.rs:810
8502025-03-08T00:36:59.626ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8512025-03-08T00:36:59.837ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8522025-03-08T00:36:59.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41575
8532025-03-08T00:36:59.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41575 req_id = 64711d02-27fe-4d7e-8f2f-eb8eab5b16ef response_code = 200 uri = /timesync
8542025-03-08T00:36:59.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.390702128 } file = sled-agent/src/rack_setup/service.rs:810
8552025-03-08T00:36:59.848ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8562025-03-08T00:37:00.158ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8572025-03-08T00:37:00.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41889
8582025-03-08T00:37:00.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41889 req_id = e03a3a1e-c4ec-423a-9a5c-fc0326a7d869 response_code = 200 uri = /timesync
8592025-03-08T00:37:00.168ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.388364077 } file = sled-agent/src/rack_setup/service.rs:810
8602025-03-08T00:37:00.169ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8612025-03-08T00:37:00.459ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8622025-03-08T00:37:00.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57590
8632025-03-08T00:37:00.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57590 req_id = 2ebfa90f-863a-4f95-9aa6-23ae8ada32d3 response_code = 200 uri = /timesync
8642025-03-08T00:37:00.469ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.387547076 } file = sled-agent/src/rack_setup/service.rs:810
8652025-03-08T00:37:00.469ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8662025-03-08T00:37:00.781ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8672025-03-08T00:37:00.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36684
8682025-03-08T00:37:00.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8413 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36684 req_id = 415c4bc1-d21b-4836-a0ee-5c609d82e690 response_code = 200 uri = /timesync
8692025-03-08T00:37:00.791ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394220.0852149, correction: -0.388611704 } file = sled-agent/src/rack_setup/service.rs:810
8702025-03-08T00:37:00.791ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8712025-03-08T00:37:00.955ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8722025-03-08T00:37:00.955ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8732025-03-08T00:37:01.331ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8742025-03-08T00:37:01.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43266
8752025-03-08T00:37:01.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43266 req_id = 5022e6ea-12e2-4ec4-bee2-0053758fbc30 response_code = 200 uri = /timesync
8762025-03-08T00:37:01.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.387117743 } file = sled-agent/src/rack_setup/service.rs:810
8772025-03-08T00:37:01.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8782025-03-08T00:37:02.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8792025-03-08T00:37:02.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44467
8802025-03-08T00:37:02.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7819 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44467 req_id = b5aac9bb-46a2-4c27-a6ba-60e804512a33 response_code = 200 uri = /timesync
8812025-03-08T00:37:02.144ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741394217.5936897, correction: -0.383136392 } file = sled-agent/src/rack_setup/service.rs:810
8822025-03-08T00:37:02.144ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8832025-03-08T00:37:02.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8842025-03-08T00:37:02.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63190
8852025-03-08T00:37:02.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63190 req_id = b5107250-8546-4d87-abca-14298912a6cc response_code = 200 uri = /timesync
8862025-03-08T00:37:02.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394221.5215695, correction: -0.381125242 } file = sled-agent/src/rack_setup/service.rs:810
8872025-03-08T00:37:02.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8882025-03-08T00:37:03.194ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8892025-03-08T00:37:03.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47983
8902025-03-08T00:37:03.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47983 req_id = 23859ff4-60a2-4f5c-958d-fc3ba25c8450 response_code = 200 uri = /timesync
8912025-03-08T00:37:03.206ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394221.5215695, correction: -0.379772097 } file = sled-agent/src/rack_setup/service.rs:810
8922025-03-08T00:37:03.206ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8932025-03-08T00:37:03.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8942025-03-08T00:37:03.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44949
8952025-03-08T00:37:04.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44949 req_id = d3b37342-6bf6-4d5d-a418-b1916b212172 response_code = 200 uri = /timesync
8962025-03-08T00:37:04.004ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394222.7645905, correction: -0.376844376 } file = sled-agent/src/rack_setup/service.rs:810
8972025-03-08T00:37:04.004ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8982025-03-08T00:37:05.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
8992025-03-08T00:37:05.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9002025-03-08T00:37:05.102ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9012025-03-08T00:37:05.599ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9022025-03-08T00:37:05.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47285
9032025-03-08T00:37:05.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47285 req_id = d7946c75-1e6f-45ae-a08f-4f0c3c5e0a0f response_code = 200 uri = /timesync
9042025-03-08T00:37:05.611ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394224.0888605, correction: -0.372364312 } file = sled-agent/src/rack_setup/service.rs:810
9052025-03-08T00:37:05.611ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9062025-03-08T00:37:06.535ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9072025-03-08T00:37:06.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60410
9082025-03-08T00:37:06.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60410 req_id = 296cc7ad-95dc-4809-9454-49ad427a1550 response_code = 200 uri = /timesync
9092025-03-08T00:37:06.547ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394224.6694157, correction: -0.369485945 } file = sled-agent/src/rack_setup/service.rs:810
9102025-03-08T00:37:06.547ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9112025-03-08T00:37:06.722ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32796
9122025-03-08T00:37:06.722ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32796 req_id = 6245a3c8-c1a8-4137-9dad-59fe5067067f response_code = 200 uri = /baseboard
9132025-03-08T00:37:06.890ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9142025-03-08T00:37:06.890ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9152025-03-08T00:37:07.340ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9162025-03-08T00:37:07.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9172025-03-08T00:37:08.830ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9182025-03-08T00:37:08.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34116
9192025-03-08T00:37:08.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34116 req_id = 03b69bfa-bd57-492e-9367-a563dada2c7e response_code = 200 uri = /timesync
9202025-03-08T00:37:08.843ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394227.7236922, correction: -0.363300532 } file = sled-agent/src/rack_setup/service.rs:810
9212025-03-08T00:37:08.843ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9222025-03-08T00:37:10.697ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9232025-03-08T00:37:10.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60288
9242025-03-08T00:37:10.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60288 req_id = 6d9aef46-7db6-49da-a595-ac396ed35819 response_code = 200 uri = /timesync
9252025-03-08T00:37:10.709ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394228.9186966, correction: -0.35807842 } file = sled-agent/src/rack_setup/service.rs:810
9262025-03-08T00:37:10.709ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9272025-03-08T00:37:10.929ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9282025-03-08T00:37:10.929ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9292025-03-08T00:37:11.096ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 191.442367ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9302025-03-08T00:37:11.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9312025-03-08T00:37:11.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52045
9322025-03-08T00:37:11.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8904 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52045 req_id = 9569fa9c-1b43-4f11-9b28-3b7ad1a46ed9 response_code = 200 uri = /timesync
9332025-03-08T00:37:11.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394231.226481, correction: -0.354995906 } file = sled-agent/src/rack_setup/service.rs:810
9342025-03-08T00:37:11.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9352025-03-08T00:37:14.701ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
9362025-03-08T00:37:14.701ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
9372025-03-08T00:37:14.701ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
9382025-03-08T00:37:14.702ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
9392025-03-08T00:37:15.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9402025-03-08T00:37:15.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9412025-03-08T00:37:15.078ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9422025-03-08T00:37:15.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9432025-03-08T00:37:15.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41595
9442025-03-08T00:37:15.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41595 req_id = bba475ee-9ba1-4e88-8add-49a4b2b3557f response_code = 200 uri = /timesync
9452025-03-08T00:37:15.270ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394234.0761356, correction: -0.345756143 } file = sled-agent/src/rack_setup/service.rs:810
9462025-03-08T00:37:15.270ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9472025-03-08T00:37:16.865ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9482025-03-08T00:37:16.865ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9492025-03-08T00:37:17.315ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9502025-03-08T00:37:17.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9512025-03-08T00:37:17.905ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9522025-03-08T00:37:17.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43610
9532025-03-08T00:37:17.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8511 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43610 req_id = 3a0e9803-0b75-46da-9872-2bf0e9828ea5 response_code = 200 uri = /timesync
9542025-03-08T00:37:17.916ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394236.3272872, correction: -0.338410556 } file = sled-agent/src/rack_setup/service.rs:810
9552025-03-08T00:37:17.916ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9562025-03-08T00:37:20.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9572025-03-08T00:37:20.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9582025-03-08T00:37:22.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9592025-03-08T00:37:22.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59933
9602025-03-08T00:37:22.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59933 req_id = b8988cb1-7802-4019-807b-99883dc740d3 response_code = 200 uri = /timesync
9612025-03-08T00:37:22.199ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394239.8540096, correction: -0.326774746 } file = sled-agent/src/rack_setup/service.rs:810
9622025-03-08T00:37:22.199ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9632025-03-08T00:37:25.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9642025-03-08T00:37:25.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9652025-03-08T00:37:25.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9662025-03-08T00:37:26.279ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 294.227414ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9672025-03-08T00:37:26.840ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 474194971753257727 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9682025-03-08T00:37:26.841ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15675263083138639513 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9692025-03-08T00:37:27.289ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9702025-03-08T00:37:27.290ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9712025-03-08T00:37:27.629ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9722025-03-08T00:37:27.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50787
9732025-03-08T00:37:27.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50787 req_id = 6f295711-cb15-4b23-b345-45398f384770 response_code = 200 uri = /timesync
9742025-03-08T00:37:27.643ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394245.6098502, correction: -0.311775655 } file = sled-agent/src/rack_setup/service.rs:810
9752025-03-08T00:37:27.643ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9762025-03-08T00:37:30.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9772025-03-08T00:37:30.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9782025-03-08T00:37:33.243ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9792025-03-08T00:37:33.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52220
9802025-03-08T00:37:33.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52220 req_id = 937759e9-6aea-4a7c-8f29-d7acbe1f63d6 response_code = 200 uri = /timesync
9812025-03-08T00:37:33.256ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394250.3859534, correction: -0.296726733 } file = sled-agent/src/rack_setup/service.rs:810
9822025-03-08T00:37:33.256ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9832025-03-08T00:37:35.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9842025-03-08T00:37:35.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9852025-03-08T00:37:35.028ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9862025-03-08T00:37:36.673ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53284
9872025-03-08T00:37:36.673ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53284 req_id = d4c5d084-e84e-41e0-93a1-640ac22b9c53 response_code = 200 uri = /baseboard
9882025-03-08T00:37:37.265ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9892025-03-08T00:37:37.265ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9902025-03-08T00:37:40.511ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
9912025-03-08T00:37:40.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37720
9922025-03-08T00:37:40.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37720 req_id = c051ce22-e6b5-4f05-b202-f2ad21516d8c response_code = 200 uri = /timesync
9932025-03-08T00:37:40.524ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394258.6393397, correction: -0.27710858 } file = sled-agent/src/rack_setup/service.rs:810
9942025-03-08T00:37:40.524ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
9952025-03-08T00:37:40.854ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9962025-03-08T00:37:40.855ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9972025-03-08T00:37:41.566ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.147163747s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9982025-03-08T00:37:45.003ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8200606999117189291 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
9992025-03-08T00:37:45.003ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4869964252413808262 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10002025-03-08T00:37:45.004ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3182402723699145711 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10012025-03-08T00:37:47.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10022025-03-08T00:37:47.240ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10032025-03-08T00:37:50.830ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18222966154112565023 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10042025-03-08T00:37:50.830ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10501680051162502104 reason = Duration(60s) sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10052025-03-08T00:37:50.892ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10062025-03-08T00:37:50.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47236
10072025-03-08T00:37:50.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47236 req_id = ac919ada-c7ad-4730-97ea-c5c1bd8c5cb9 response_code = 200 uri = /timesync
10082025-03-08T00:37:50.904ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394266.3202696, correction: -0.248798817 } file = sled-agent/src/rack_setup/service.rs:810
10092025-03-08T00:37:50.904ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
10102025-03-08T00:37:57.215ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10112025-03-08T00:37:57.215ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10122025-03-08T00:37:57.704ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.022913763s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10132025-03-08T00:37:59.073ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10142025-03-08T00:37:59.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65213
10152025-03-08T00:37:59.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9536 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65213 req_id = 78192458-336b-424c-abcf-caade095f262 response_code = 200 uri = /timesync
10162025-03-08T00:37:59.085ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394274.1121483, correction: -0.226459756 } file = sled-agent/src/rack_setup/service.rs:810
10172025-03-08T00:37:59.085ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
10182025-03-08T00:38:06.624ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58939
10192025-03-08T00:38:06.624ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58939 req_id = df904834-0001-4b9c-b457-ce17afc39421 response_code = 200 uri = /baseboard
10202025-03-08T00:38:07.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10212025-03-08T00:38:07.190ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10222025-03-08T00:38:14.539ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
10232025-03-08T00:38:14.539ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
10242025-03-08T00:38:14.539ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
10252025-03-08T00:38:14.539ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
10262025-03-08T00:38:14.715ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.839847134s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10272025-03-08T00:38:15.212ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10282025-03-08T00:38:15.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58314
10292025-03-08T00:38:15.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58314 req_id = 4a5dbf7f-1337-4ed8-b976-0e27c834ee14 response_code = 200 uri = /timesync
10302025-03-08T00:38:15.227ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394290.626077, correction: -0.182644904 } file = sled-agent/src/rack_setup/service.rs:810
10312025-03-08T00:38:15.227ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
10322025-03-08T00:38:17.164ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10332025-03-08T00:38:17.164ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10342025-03-08T00:38:27.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10352025-03-08T00:38:27.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10362025-03-08T00:38:31.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10372025-03-08T00:38:31.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54910
10382025-03-08T00:38:31.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54910 req_id = db8de793-c625-40c7-b9a3-d888be0ad041 response_code = 200 uri = /timesync
10392025-03-08T00:38:31.180ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394307.1893284, correction: -0.139519617 } file = sled-agent/src/rack_setup/service.rs:810
10402025-03-08T00:38:31.180ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
10412025-03-08T00:38:34.535ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.612780964s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10422025-03-08T00:38:36.576ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38648
10432025-03-08T00:38:36.576ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38648 req_id = 2e5331db-2cb6-4cec-aeff-308731744445 response_code = 200 uri = /baseboard
10442025-03-08T00:38:37.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10452025-03-08T00:38:37.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10462025-03-08T00:38:47.088ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10472025-03-08T00:38:47.089ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10482025-03-08T00:38:53.063ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10492025-03-08T00:38:53.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35296
10502025-03-08T00:38:53.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9833 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35296 req_id = 5816474a-1273-4017-9846-2f75e828bf01 response_code = 200 uri = /timesync
10512025-03-08T00:38:53.076ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1741394331.6654854, correction: -0.080327764 } file = sled-agent/src/rack_setup/service.rs:810
10522025-03-08T00:38:53.076ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
10532025-03-08T00:38:55.128ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.924720269s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10542025-03-08T00:38:57.063ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14876399588052105871 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10552025-03-08T00:38:57.063ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 235620758871179282 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10562025-03-08T00:39:04.262ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
10572025-03-08T00:39:04.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39034
10582025-03-08T00:39:04.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 23932 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39034 req_id = 70e9673c-6eca-478e-bd88-d26459b26048 response_code = 200 uri = /timesync
10592025-03-08T00:39:04.286ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:45.003658423Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8200606999117189291 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10602025-03-08T00:39:04.288ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:45.004231548Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3182402723699145711 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10612025-03-08T00:39:04.288ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:26.841680154Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15675263083138639513 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10622025-03-08T00:39:04.288ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:45.003965111Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4869964252413808262 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10632025-03-08T00:39:04.289ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:26.840942036Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 474194971753257727 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10642025-03-08T00:39:04.289ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:50.830326242Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18222966154112565023 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10652025-03-08T00:39:04.289ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-03-08T00:37:50.830638609Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10501680051162502104 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
10662025-03-08T00:39:04.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2901090547, ip_addr: 172.235.32.243, stratum: 3, ref_time: 1741394331.371989, correction: -0.049395051 } file = sled-agent/src/rack_setup/service.rs:810
10672025-03-08T00:39:04.290ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1445
10682025-03-08T00:39:04.319ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 508de01a-93ec-4309-a59e-0cfd22b5027a (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1ac98a83-1243-46f5-99db-fd29222026d8 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7a2ff4e8-6697-4c29-ad00-14a8b25b198c (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bc0e0b9f-0d87-400e-bb99-5f74ae28ea72, kind: Service { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 }, name: Name("ntp-fb5d8045-9a48-4848-a7a5-55a8d8d968c0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 777b3ea2-976b-4b60-970e-158f566b4684 (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: cad67e89-0dec-4740-870f-c1625d0f0ac1 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2875192f-2bc2-4a69-a3ee-7eb8ae918949 (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 62799bc0-b6c2-4a10-b648-385f95573fa1 (service), filesystem_pool: Some(ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: caeb7565-4a86-4942-9e62-e2f8a80c2183 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
10692025-03-08T00:39:04.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49643
10702025-03-08T00:39:04.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-03-08T00:39:04.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10722025-03-08T00:39:04.331ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-03-08T00:39:04.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10742025-03-08T00:39:04.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-03-08T00:39:04.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10762025-03-08T00:39:04.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-03-08T00:39:04.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10782025-03-08T00:39:04.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-03-08T00:39:04.361ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802025-03-08T00:39:04.371ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-03-08T00:39:04.371ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10822025-03-08T00:39:04.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-03-08T00:39:04.381ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10842025-03-08T00:39:04.390ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-03-08T00:39:04.390ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10862025-03-08T00:39:04.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10872025-03-08T00:39:04.399ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
10882025-03-08T00:39:04.399ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
10892025-03-08T00:39:04.399ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
10902025-03-08T00:39:04.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912025-03-08T00:39:04.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-03-08T00:39:04.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-03-08T00:39:04.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942025-03-08T00:39:04.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-03-08T00:39:04.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962025-03-08T00:39:04.571ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684 file = illumos-utils/src/zone.rs:327
10972025-03-08T00:39:04.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1 file = illumos-utils/src/zone.rs:327
10982025-03-08T00:39:04.578ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183 file = illumos-utils/src/zone.rs:327
10992025-03-08T00:39:04.583ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 file = illumos-utils/src/zone.rs:327
11002025-03-08T00:39:04.587ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1 file = illumos-utils/src/zone.rs:327
11012025-03-08T00:39:04.591ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684 file = illumos-utils/src/zone.rs:365
11022025-03-08T00:39:04.596ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1 file = illumos-utils/src/zone.rs:365
11032025-03-08T00:39:04.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183 file = illumos-utils/src/zone.rs:365
11042025-03-08T00:39:04.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 file = illumos-utils/src/zone.rs:365
11052025-03-08T00:39:04.609ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1 file = illumos-utils/src/zone.rs:365
11062025-03-08T00:39:06.527ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48130
11072025-03-08T00:39:06.527ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48130 req_id = 15760f15-4aa7-4dfe-95a5-14af0c19251a response_code = 200 uri = /baseboard
11082025-03-08T00:39:07.750ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2875192f-2bc2-4a69-a3ee-7eb8ae918949'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092025-03-08T00:39:07.750ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11102025-03-08T00:39:07.757ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='caeb7565-4a86-4942-9e62-e2f8a80c2183'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11112025-03-08T00:39:07.757ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11122025-03-08T00:39:07.803ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='777b3ea2-976b-4b60-970e-158f566b4684'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11132025-03-08T00:39:07.803ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11142025-03-08T00:39:07.810ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cad67e89-0dec-4740-870f-c1625d0f0ac1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11152025-03-08T00:39:07.810ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11162025-03-08T00:39:07.828ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='62799bc0-b6c2-4a10-b648-385f95573fa1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11172025-03-08T00:39:07.828ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11182025-03-08T00:39:07.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 65.350122ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11192025-03-08T00:39:07.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 66.114521ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11202025-03-08T00:39:07.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 26.113813ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11212025-03-08T00:39:07.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 72.262414ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11222025-03-08T00:39:07.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 73.027167ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11232025-03-08T00:39:08.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 79.879467ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11242025-03-08T00:39:08.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 52.329264ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11252025-03-08T00:39:08.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 51.804739ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11262025-03-08T00:39:08.927ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 297.355819ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11272025-03-08T00:39:08.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 142.702709ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11282025-03-08T00:39:09.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 162.213749ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11292025-03-08T00:39:09.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 132.186942ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11302025-03-08T00:39:09.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 127.64196ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11312025-03-08T00:39:09.163ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 224.526788ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11322025-03-08T00:39:09.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 288.026051ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11332025-03-08T00:39:09.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 219.200338ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11342025-03-08T00:39:09.265ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 329.032201ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11352025-03-08T00:39:09.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 220.885127ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11362025-03-08T00:39:09.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 545.410786ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11372025-03-08T00:39:09.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.153983457s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11382025-03-08T00:39:09.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 1.095547096s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11392025-03-08T00:39:09.515ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 267.984437ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11402025-03-08T00:39:09.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 1.194286372s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11412025-03-08T00:39:09.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 647.986094ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11422025-03-08T00:39:09.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.119466181s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11432025-03-08T00:39:10.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.343253281s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11442025-03-08T00:39:10.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 1.028248976s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11452025-03-08T00:39:10.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 621.047243ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11462025-03-08T00:39:10.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 919.994069ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11472025-03-08T00:39:11.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.418041997s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11482025-03-08T00:39:11.242ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.084639113s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11492025-03-08T00:39:11.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 553.606908ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11502025-03-08T00:39:11.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 921.204031ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11512025-03-08T00:39:11.804ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.080131946s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11522025-03-08T00:39:12.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 1.093112208s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11532025-03-08T00:39:12.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 719.446548ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11542025-03-08T00:39:12.511ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.220843978s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11552025-03-08T00:39:12.681ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 734.426212ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11562025-03-08T00:39:12.891ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 718.36014ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11572025-03-08T00:39:13.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 967.340283ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11582025-03-08T00:39:13.300ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 1.127288376s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11592025-03-08T00:39:13.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 883.571855ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11602025-03-08T00:39:13.618ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 849.008418ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11612025-03-08T00:39:13.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 555.429167ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11622025-03-08T00:39:14.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.216898038s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11632025-03-08T00:39:14.301ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 692.308001ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11642025-03-08T00:39:14.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 779.484391ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11652025-03-08T00:39:14.375ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
11662025-03-08T00:39:14.376ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
11672025-03-08T00:39:14.376ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
11682025-03-08T00:39:14.376ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
11692025-03-08T00:39:14.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 765.415414ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11702025-03-08T00:39:14.472ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.044315s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11712025-03-08T00:39:15.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.057639663s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11722025-03-08T00:39:15.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 1.232195685s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11732025-03-08T00:39:15.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 585.830154ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11742025-03-08T00:39:15.256ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.158295466s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11752025-03-08T00:39:15.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.318078783s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11762025-03-08T00:39:15.802ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 866.548062ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11772025-03-08T00:39:16.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 828.442626ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11782025-03-08T00:39:16.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 558.792757ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11792025-03-08T00:39:16.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.348778501s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11802025-03-08T00:39:16.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 1.028502369s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11812025-03-08T00:39:16.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.285987985s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11822025-03-08T00:39:16.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 680.627228ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11832025-03-08T00:39:16.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 688.312524ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11842025-03-08T00:39:17.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 824.015736ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11852025-03-08T00:39:17.610ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 1.264973385s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11862025-03-08T00:39:17.712ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 538.483479ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11872025-03-08T00:39:17.775ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 555.996809ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11882025-03-08T00:39:18.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 553.625827ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11892025-03-08T00:39:18.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 796.329566ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11902025-03-08T00:39:18.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.211721017s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11912025-03-08T00:39:18.425ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.076403757s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11922025-03-08T00:39:18.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 1.341901938s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11932025-03-08T00:39:18.881ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684") failed: Property not found. retry in 1.127472942s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
11942025-03-08T00:39:19.023ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.582327762s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
11952025-03-08T00:39:19.063ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183") failed: Property not found. retry in 705.975407ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
11962025-03-08T00:39:19.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1") failed: Property not found. retry in 1.065946332s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
11972025-03-08T00:39:19.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 552.547065ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
11982025-03-08T00:39:20.052ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1") failed: Property not found. retry in 860.483557ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
11992025-03-08T00:39:20.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949") failed: Property not found. retry in 1.241321235s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
12002025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_777b3ea2-976b-4b60-970e-158f566b4684
12012025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_62799bc0-b6c2-4a10-b648-385f95573fa1
12022025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_caeb7565-4a86-4942-9e62-e2f8a80c2183
12032025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949
12042025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_cad67e89-0dec-4740-870f-c1625d0f0ac1
12052025-03-08T00:39:21.378ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
12062025-03-08T00:39:21.379ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
12072025-03-08T00:39:21.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17106103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49643 req_id = 70c3f916-ca19-4cae-9b11-c81675546291 response_code = 204 uri = /omicron-zones
12082025-03-08T00:39:21.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40937
12092025-03-08T00:39:21.443ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 4d381586-a7c8-4a2c-83a9-4ac46e721601 response_code = 500 uri = /cockroachdb
12102025-03-08T00:39:21.443ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4d381586-a7c8-4a2c-83a9-4ac46e721601", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4d381586-a7c8-4a2c-83a9-4ac46e721601" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 74.169278ms
12112025-03-08T00:39:21.543ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 4eccf5ae-33eb-4687-8a90-25b267d8cf0f response_code = 500 uri = /cockroachdb
12122025-03-08T00:39:21.543ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4eccf5ae-33eb-4687-8a90-25b267d8cf0f", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4eccf5ae-33eb-4687-8a90-25b267d8cf0f" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 74.852856ms
12132025-03-08T00:39:21.644ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 3f947d69-00ec-491f-bd27-fb7224fb995f response_code = 500 uri = /cockroachdb
12142025-03-08T00:39:21.644ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3f947d69-00ec-491f-bd27-fb7224fb995f", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3f947d69-00ec-491f-bd27-fb7224fb995f" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 209.850592ms
12152025-03-08T00:39:21.882ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 98be2762-48e9-4080-b0a9-49d0722e6288 response_code = 500 uri = /cockroachdb
12162025-03-08T00:39:21.882ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "98be2762-48e9-4080-b0a9-49d0722e6288", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "98be2762-48e9-4080-b0a9-49d0722e6288" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 173.859256ms
12172025-03-08T00:39:22.081ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 24014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 787680ef-94c7-4f45-8312-bf069fb4c715 response_code = 500 uri = /cockroachdb
12182025-03-08T00:39:22.081ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "787680ef-94c7-4f45-8312-bf069fb4c715", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "787680ef-94c7-4f45-8312-bf069fb4c715" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 244.458774ms
12192025-03-08T00:39:22.351ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 24452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = d0405a78-362b-4e1c-8c12-5fd8db829c57 response_code = 500 uri = /cockroachdb
12202025-03-08T00:39:22.351ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d0405a78-362b-4e1c-8c12-5fd8db829c57", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d0405a78-362b-4e1c-8c12-5fd8db829c57" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 167.366007ms
12212025-03-08T00:39:22.547ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27985 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 7aa20af7-7391-4b7e-87c7-5a8944e63b52 response_code = 500 uri = /cockroachdb
12222025-03-08T00:39:22.548ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7aa20af7-7391-4b7e-87c7-5a8944e63b52", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7aa20af7-7391-4b7e-87c7-5a8944e63b52" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 254.119385ms
12232025-03-08T00:39:22.827ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 24924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 63cc67a2-1b56-4640-9ec0-22445e2691d5 response_code = 500 uri = /cockroachdb
12242025-03-08T00:39:22.827ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "63cc67a2-1b56-4640-9ec0-22445e2691d5", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "63cc67a2-1b56-4640-9ec0-22445e2691d5" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 254.128145ms
12252025-03-08T00:39:23.114ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 31959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = c58aca08-9aa6-41dc-aa98-9ca5973b52e8 response_code = 500 uri = /cockroachdb
12262025-03-08T00:39:23.114ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c58aca08-9aa6-41dc-aa98-9ca5973b52e8", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c58aca08-9aa6-41dc-aa98-9ca5973b52e8" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 466.905935ms
12272025-03-08T00:39:23.611ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2875192f-2bc2-4a69-a3ee-7eb8ae918949 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = 01a30c38-ae79-4274-8717-b5da69861b9d response_code = 500 uri = /cockroachdb
12282025-03-08T00:39:23.612ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "01a30c38-ae79-4274-8717-b5da69861b9d", "content-length": "124", "date": "Sat, 08 Mar 2025 00:39:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "01a30c38-ae79-4274-8717-b5da69861b9d" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 294.101141ms
12292025-03-08T00:39:23.942ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3818
12302025-03-08T00:39:34.883ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3836
12312025-03-08T00:39:40.358ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3859
12322025-03-08T00:39:40.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 16451321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40937 req_id = cdfcdd73-d61c-4e16-972c-0eb89d114e76 response_code = 204 uri = /cockroachdb
12332025-03-08T00:39:40.359ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42427
12342025-03-08T00:39:40.360ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 556 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42427 req_id = 684181ef-084e-4898-a978-b202169cdbe8 response_code = 200 uri = /baseboard
12352025-03-08T00:39:40.404ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 508de01a-93ec-4309-a59e-0cfd22b5027a (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: 1ac98a83-1243-46f5-99db-fd29222026d8 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 7a2ff4e8-6697-4c29-ad00-14a8b25b198c (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bc0e0b9f-0d87-400e-bb99-5f74ae28ea72, kind: Service { id: fb5d8045-9a48-4848-a7a5-55a8d8d968c0 }, name: Name("ntp-fb5d8045-9a48-4848-a7a5-55a8d8d968c0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 247])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 777b3ea2-976b-4b60-970e-158f566b4684 (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: cad67e89-0dec-4740-870f-c1625d0f0ac1 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2875192f-2bc2-4a69-a3ee-7eb8ae918949 (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 62799bc0-b6c2-4a10-b648-385f95573fa1 (service), filesystem_pool: Some(ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: caeb7565-4a86-4942-9e62-e2f8a80c2183 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: da0d8428-046e-431d-9a82-470b80ca232a (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 59287b7e-0d61-4586-b7c5-e79476927737 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f (service), filesystem_pool: Some(ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 4d603338-4154-45db-a26b-b6679dc7f0ec (service), filesystem_pool: Some(ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: c5a56912-50aa-493d-9612-f426cf7f1072 (service), filesystem_pool: Some(ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: ced54ff7-02b2-4342-ba41-ce79c4f2bc98 (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 196d75e7-fd8a-4aaa-abde-011428769331 (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 69ed853c-dd53-42e9-b823-c309b1721af5 (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 0c6794b6-6250-42cb-8b59-71e901b7e824 (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 2de3e77c-d783-4b91-be44-cced0891ce8e (service), filesystem_pool: Some(ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b342cde1-1872-419c-825e-6ba9793c6da8 (service), filesystem_pool: Some(ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b62ddf05-bf70-4650-8e3f-845847751e88 (service), filesystem_pool: Some(ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 25a40df9-fd80-42f0-adc4-b4dff511e53d (service), filesystem_pool: Some(ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8300c829-49f9-4839-892a-078272d50f4c (service), filesystem_pool: Some(ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: a4314bb8-ec23-42c2-8b82-e7f3905c6dec (service), filesystem_pool: Some(ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1 (service), filesystem_pool: Some(ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 68e186b9-4e79-4c69-aca1-ca0f5c04390b (service), filesystem_pool: Some(ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 1176eac2-12ea-4684-a2d7-4423954b6e69 (service), filesystem_pool: Some(ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
12362025-03-08T00:39:40.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45332
12372025-03-08T00:39:40.406ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12382025-03-08T00:39:40.406ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12392025-03-08T00:39:40.421ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12402025-03-08T00:39:40.421ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12412025-03-08T00:39:40.432ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12422025-03-08T00:39:40.432ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12432025-03-08T00:39:40.443ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12442025-03-08T00:39:40.443ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12452025-03-08T00:39:40.453ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12462025-03-08T00:39:40.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12472025-03-08T00:39:40.463ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12482025-03-08T00:39:40.463ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12492025-03-08T00:39:40.473ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12502025-03-08T00:39:40.473ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12512025-03-08T00:39:40.482ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12522025-03-08T00:39:40.482ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12532025-03-08T00:39:40.490ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12542025-03-08T00:39:40.490ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12552025-03-08T00:39:40.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12562025-03-08T00:39:40.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12572025-03-08T00:39:40.507ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12582025-03-08T00:39:40.507ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12592025-03-08T00:39:40.517ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12602025-03-08T00:39:40.517ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, kind: Crucible }, responder: ... }
12612025-03-08T00:39:40.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12622025-03-08T00:39:40.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, kind: Crucible }, responder: ... }
12632025-03-08T00:39:40.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12642025-03-08T00:39:40.536ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, kind: Crucible }, responder: ... }
12652025-03-08T00:39:40.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12662025-03-08T00:39:40.545ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, kind: Crucible }, responder: ... }
12672025-03-08T00:39:40.554ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12682025-03-08T00:39:40.554ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12692025-03-08T00:39:40.563ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12702025-03-08T00:39:40.563ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, kind: Crucible }, responder: ... }
12712025-03-08T00:39:40.573ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12722025-03-08T00:39:40.573ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, kind: Crucible }, responder: ... }
12732025-03-08T00:39:40.583ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12742025-03-08T00:39:40.583ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, kind: Crucible }, responder: ... }
12752025-03-08T00:39:40.592ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12762025-03-08T00:39:40.592ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12772025-03-08T00:39:40.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12782025-03-08T00:39:40.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
12792025-03-08T00:39:40.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
12802025-03-08T00:39:40.603ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
12812025-03-08T00:39:40.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12822025-03-08T00:39:40.760ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12832025-03-08T00:39:40.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12842025-03-08T00:39:40.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12852025-03-08T00:39:40.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12862025-03-08T00:39:40.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12872025-03-08T00:39:40.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12882025-03-08T00:39:40.763ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12892025-03-08T00:39:40.774ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12902025-03-08T00:39:40.775ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12912025-03-08T00:39:40.777ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12922025-03-08T00:39:41.004ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12932025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12942025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12952025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12962025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12972025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12982025-03-08T00:39:41.004ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12992025-03-08T00:39:41.020ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
13002025-03-08T00:39:41.020ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13012025-03-08T00:39:41.020ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331 file = illumos-utils/src/zone.rs:327
13022025-03-08T00:39:41.026ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5 file = illumos-utils/src/zone.rs:327
13032025-03-08T00:39:41.032ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b file = illumos-utils/src/zone.rs:327
13042025-03-08T00:39:41.037ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec file = illumos-utils/src/zone.rs:327
13052025-03-08T00:39:41.043ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1 file = illumos-utils/src/zone.rs:327
13062025-03-08T00:39:41.049ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69 file = illumos-utils/src/zone.rs:327
13072025-03-08T00:39:41.056ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072 file = illumos-utils/src/zone.rs:327
13082025-03-08T00:39:41.205ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331 file = illumos-utils/src/zone.rs:365
13092025-03-08T00:39:41.211ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5 file = illumos-utils/src/zone.rs:365
13102025-03-08T00:39:41.216ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b file = illumos-utils/src/zone.rs:365
13112025-03-08T00:39:41.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec file = illumos-utils/src/zone.rs:365
13122025-03-08T00:39:41.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1 file = illumos-utils/src/zone.rs:365
13132025-03-08T00:39:41.231ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69 file = illumos-utils/src/zone.rs:365
13142025-03-08T00:39:41.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072 file = illumos-utils/src/zone.rs:365
13152025-03-08T00:39:41.243ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88 file = illumos-utils/src/zone.rs:327
13162025-03-08T00:39:41.249ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d file = illumos-utils/src/zone.rs:327
13172025-03-08T00:39:41.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8 file = illumos-utils/src/zone.rs:327
13182025-03-08T00:39:41.259ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98 file = illumos-utils/src/zone.rs:327
13192025-03-08T00:39:41.264ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c file = illumos-utils/src/zone.rs:327
13202025-03-08T00:39:41.268ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824 file = illumos-utils/src/zone.rs:327
13212025-03-08T00:39:41.274ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e file = illumos-utils/src/zone.rs:327
13222025-03-08T00:39:41.332ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13232025-03-08T00:39:41.333ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88 file = illumos-utils/src/zone.rs:365
13242025-03-08T00:39:41.345ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d file = illumos-utils/src/zone.rs:365
13252025-03-08T00:39:41.354ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8 file = illumos-utils/src/zone.rs:365
13262025-03-08T00:39:41.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98 file = illumos-utils/src/zone.rs:365
13272025-03-08T00:39:41.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c file = illumos-utils/src/zone.rs:365
13282025-03-08T00:39:41.387ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824 file = illumos-utils/src/zone.rs:365
13292025-03-08T00:39:41.398ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e file = illumos-utils/src/zone.rs:365
13302025-03-08T00:39:41.475ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13312025-03-08T00:39:41.539ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13322025-03-08T00:39:41.601ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13332025-03-08T00:39:41.605ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13342025-03-08T00:39:41.605ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13352025-03-08T00:39:41.660ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 237, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13362025-03-08T00:39:41.660ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
13372025-03-08T00:39:41.661ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13382025-03-08T00:39:41.662ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13392025-03-08T00:39:41.715ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 149, 101]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13402025-03-08T00:39:41.715ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
13412025-03-08T00:39:41.716ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13422025-03-08T00:39:41.716ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13432025-03-08T00:39:41.773ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 173, 106]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13442025-03-08T00:39:41.773ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
13452025-03-08T00:39:41.775ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13462025-03-08T00:39:41.775ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13472025-03-08T00:39:41.831ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 228, 176]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13482025-03-08T00:39:41.831ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
13492025-03-08T00:39:41.893ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13502025-03-08T00:39:41.895ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13512025-03-08T00:39:41.895ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13522025-03-08T00:39:41.953ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 182, 217]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13532025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
13542025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13552025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13562025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13572025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13582025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13592025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13602025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13612025-03-08T00:39:41.954ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13622025-03-08T00:39:41.955ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13632025-03-08T00:39:41.955ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13642025-03-08T00:39:41.960ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13652025-03-08T00:39:41.962ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13662025-03-08T00:39:41.962ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13672025-03-08T00:39:41.964ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13682025-03-08T00:39:41.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13692025-03-08T00:39:41.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13702025-03-08T00:39:41.966ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13712025-03-08T00:39:41.968ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13722025-03-08T00:39:41.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13732025-03-08T00:39:41.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13742025-03-08T00:39:42.195ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f file = illumos-utils/src/zone.rs:327
13752025-03-08T00:39:42.205ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d file = illumos-utils/src/zone.rs:327
13762025-03-08T00:39:42.219ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737 file = illumos-utils/src/zone.rs:327
13772025-03-08T00:39:42.245ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec file = illumos-utils/src/zone.rs:327
13782025-03-08T00:39:42.256ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a file = illumos-utils/src/zone.rs:327
13792025-03-08T00:39:42.268ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f file = illumos-utils/src/zone.rs:365
13802025-03-08T00:39:42.278ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d file = illumos-utils/src/zone.rs:365
13812025-03-08T00:39:42.290ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737 file = illumos-utils/src/zone.rs:365
13822025-03-08T00:39:42.299ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec file = illumos-utils/src/zone.rs:365
13832025-03-08T00:39:42.309ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a file = illumos-utils/src/zone.rs:365
13842025-03-08T00:39:51.078ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13852025-03-08T00:39:51.129ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
13862025-03-08T00:39:51.334ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d5631626-73be-43f2-9e4f-e36e76615c9c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e4186692-fcdd-4fa3-96f6-c8e25dee8106'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872025-03-08T00:39:51.334ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c2ce84d2-80f8-45d4-af6b-975439cb581f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13882025-03-08T00:39:51.335ZINFOSledAgent (ServiceManager): Booting oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
13892025-03-08T00:39:51.343ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='52a949ac-0ca8-43b2-9981-87b35fdecaf4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13902025-03-08T00:39:51.343ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2092d744-4cfa-4904-bef8-ecc1224b9bd6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13912025-03-08T00:39:51.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6b7656b9-750c-4b40-b6a4-3ca7cf73d681'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13922025-03-08T00:39:51.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0def2502-81eb-4b14-9f26-5ae960188d32/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5e7f0537-6cd0-44c4-94e6-d8e75d2e3bc6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13932025-03-08T00:39:51.344ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4891803d-fb75-46f6-be43-ddfb0b212f99'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942025-03-08T00:39:51.344ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
13952025-03-08T00:39:51.351ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
13962025-03-08T00:39:51.359ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
13972025-03-08T00:39:51.365ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
13982025-03-08T00:39:51.372ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
13992025-03-08T00:39:51.378ZINFOSledAgent (ServiceManager): Booting oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14002025-03-08T00:39:52.329ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='c5a56912-50aa-493d-9612-f426cf7f1072'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012025-03-08T00:39:52.358ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14022025-03-08T00:39:53.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 64.350252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14032025-03-08T00:39:53.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 43.566276ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14042025-03-08T00:39:53.068ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 74.592588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14052025-03-08T00:39:53.079ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 53.403055ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14062025-03-08T00:39:53.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 32.336476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14072025-03-08T00:39:53.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 32.576103ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14082025-03-08T00:39:53.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 33.067112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14092025-03-08T00:39:53.122ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 67.167209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14102025-03-08T00:39:53.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 32.979633ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14112025-03-08T00:39:53.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 98.560063ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14122025-03-08T00:39:53.159ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 82.26386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14132025-03-08T00:39:53.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 102.243695ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14142025-03-08T00:39:53.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 90.608995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14152025-03-08T00:39:53.192ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 139.604338ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14162025-03-08T00:39:53.202ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 103.445611ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14172025-03-08T00:39:53.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 146.310946ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14182025-03-08T00:39:53.229ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 116.265749ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14192025-03-08T00:39:53.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 128.707594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14202025-03-08T00:39:53.260ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 217.090892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14212025-03-08T00:39:53.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 181.505281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14222025-03-08T00:39:53.293ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 179.623285ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14232025-03-08T00:39:53.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 129.147743ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14242025-03-08T00:39:53.325ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 119.019739ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14252025-03-08T00:39:53.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 112.363965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14262025-03-08T00:39:53.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 226.688251ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14272025-03-08T00:39:53.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 286.878684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14282025-03-08T00:39:53.390ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 237.761678ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14292025-03-08T00:39:53.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 519.505241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14302025-03-08T00:39:53.466ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 550.957588ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14312025-03-08T00:39:53.479ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 370.150404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14322025-03-08T00:39:53.493ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 406.682448ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14332025-03-08T00:39:53.508ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 486.96887ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14342025-03-08T00:39:53.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 253.386594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14352025-03-08T00:39:53.605ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 501.9933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14362025-03-08T00:39:53.642ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 344.353712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14372025-03-08T00:39:53.692ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 384.050574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14382025-03-08T00:39:53.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.184992783s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14392025-03-08T00:39:53.868ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.188335194s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14402025-03-08T00:39:53.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 697.753535ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14412025-03-08T00:39:53.986ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 439.283874ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14422025-03-08T00:39:54.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.111619901s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14432025-03-08T00:39:54.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.174405798s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14442025-03-08T00:39:54.033ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 626.007411ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14452025-03-08T00:39:54.091ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 521.344697ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14462025-03-08T00:39:54.121ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 472.548083ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14472025-03-08T00:39:54.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.437308717s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14482025-03-08T00:39:54.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.466231441s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14492025-03-08T00:39:54.629ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 777.759541ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14502025-03-08T00:39:54.641ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.232511448s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14512025-03-08T00:39:54.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.33490685s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14522025-03-08T00:39:54.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 992.965598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14532025-03-08T00:39:55.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 810.960417ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14542025-03-08T00:39:55.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.088926652s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14552025-03-08T00:39:55.205ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.333360925s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14562025-03-08T00:39:55.487ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 72.861167635s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
14572025-03-08T00:39:55.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 628.606669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14582025-03-08T00:39:55.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 809.605926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14592025-03-08T00:39:55.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 814.213354ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14602025-03-08T00:39:55.914ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 755.598956ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14612025-03-08T00:39:56.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 689.352326ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14622025-03-08T00:39:56.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.499895996s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14632025-03-08T00:39:56.089ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 568.499715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14642025-03-08T00:39:56.185ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 901.874138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14652025-03-08T00:39:56.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 566.008851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14662025-03-08T00:39:56.549ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.491622366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14672025-03-08T00:39:56.667ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.27631528s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14682025-03-08T00:39:56.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 988.111618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14692025-03-08T00:39:56.700ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 876.588712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14702025-03-08T00:39:56.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.360343924s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14712025-03-08T00:39:56.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.401779278s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14722025-03-08T00:39:56.779ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14732025-03-08T00:39:56.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 964.183846ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14742025-03-08T00:39:56.838ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14752025-03-08T00:39:56.901ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14762025-03-08T00:39:56.901ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14772025-03-08T00:39:57.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 950.566989ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14782025-03-08T00:39:57.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 46.753829ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14792025-03-08T00:39:57.208ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 51.54641ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14802025-03-08T00:39:57.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 128.412424ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14812025-03-08T00:39:57.271ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 115.240866ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14822025-03-08T00:39:57.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 150.805982ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14832025-03-08T00:39:57.399ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 134.357804ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14842025-03-08T00:39:57.533ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.331588478s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
14852025-03-08T00:39:57.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 231.173976ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14862025-03-08T00:39:57.559ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 240.275183ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14872025-03-08T00:39:57.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 636.353787ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14882025-03-08T00:39:57.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 774.025394ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
14892025-03-08T00:39:57.785ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 569.929836ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14902025-03-08T00:39:57.808ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 924.06616ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
14912025-03-08T00:39:57.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.256540951s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
14922025-03-08T00:39:57.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.185914431s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
14932025-03-08T00:39:58.051ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.276134714s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
14942025-03-08T00:39:58.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 939.125391ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
14952025-03-08T00:39:58.076ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 838.112672ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
14962025-03-08T00:39:58.136ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 547.568922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
14972025-03-08T00:39:58.234ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.2851169s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
14982025-03-08T00:39:58.366ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.188825166s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
14992025-03-08T00:39:58.463ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.454858124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
15002025-03-08T00:39:58.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 837.819652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
15012025-03-08T00:39:58.741ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 710.305341ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
15022025-03-08T00:39:58.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.015454937s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
15032025-03-08T00:39:58.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 876.177202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
15042025-03-08T00:39:59.011ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 732.087554ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
15052025-03-08T00:39:59.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 810.518359ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
15062025-03-08T00:39:59.284ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.365467909s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
15072025-03-08T00:39:59.345ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.471268181s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
15082025-03-08T00:39:59.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.202219451s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
15092025-03-08T00:39:59.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.402051762s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
15102025-03-08T00:39:59.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 642.132786ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
15112025-03-08T00:39:59.566ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 666.070943ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
15122025-03-08T00:39:59.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 513.637641ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
15132025-03-08T00:39:59.824ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.251231101s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
15142025-03-08T00:39:59.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.285379719s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
15152025-03-08T00:39:59.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 956.324453ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
15162025-03-08T00:40:00.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 632.008371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
15172025-03-08T00:40:00.164ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9c216cb9-f598-41d8-8284-3a8a6113757c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15182025-03-08T00:40:00.164ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15192025-03-08T00:40:00.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.221582637s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
15202025-03-08T00:40:00.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.477869402s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
15212025-03-08T00:40:00.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 771.307019ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
15222025-03-08T00:40:00.365ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 25.620995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15232025-03-08T00:40:00.399ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 91.791799ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15242025-03-08T00:40:00.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 163.765171ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15252025-03-08T00:40:00.570ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15262025-03-08T00:40:00.578ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15272025-03-08T00:40:00.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.388432331s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
15282025-03-08T00:40:00.660ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.062213503s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
15292025-03-08T00:40:00.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 410.473409ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15302025-03-08T00:40:00.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.306287371s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
15312025-03-08T00:40:00.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 36.343066ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15322025-03-08T00:40:00.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 84.003317ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15332025-03-08T00:40:00.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 747.131459ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
15342025-03-08T00:40:00.890ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 190.653544ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15352025-03-08T00:40:00.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 804.370862ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
15362025-03-08T00:40:00.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 850.408324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
15372025-03-08T00:40:01.029ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15382025-03-08T00:40:01.031ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15392025-03-08T00:40:01.085ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15402025-03-08T00:40:01.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.211771806s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
15412025-03-08T00:40:01.124ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 250.306077ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15422025-03-08T00:40:01.137ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.445649146s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
15432025-03-08T00:40:01.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.094469566s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15442025-03-08T00:40:01.150ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15452025-03-08T00:40:01.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.172464496s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
15462025-03-08T00:40:01.323ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 35.670291ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15472025-03-08T00:40:01.339ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15482025-03-08T00:40:01.339ZINFOSledAgent (ServiceManager): Booting oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15492025-03-08T00:40:01.346ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e0013c1d-d815-4e4b-be96-32eb68284438/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7ee72c04-8a14-405d-8ccb-8b2a90c3fa59'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15502025-03-08T00:40:01.346ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15512025-03-08T00:40:01.372ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 81.494631ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15522025-03-08T00:40:01.387ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.086280595s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15532025-03-08T00:40:01.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 30.574699ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15542025-03-08T00:40:01.395ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15552025-03-08T00:40:01.395ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15562025-03-08T00:40:01.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 659.881565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
15572025-03-08T00:40:01.584ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 81.041888ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15582025-03-08T00:40:01.617ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.062039169s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
15592025-03-08T00:40:01.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 231.031118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15602025-03-08T00:40:01.677ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 212.978538ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15612025-03-08T00:40:01.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 63.402002ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15622025-03-08T00:40:01.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.17599341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
15632025-03-08T00:40:01.731ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 27.901318ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15642025-03-08T00:40:01.743ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 906.569684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
15652025-03-08T00:40:01.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 663.641408ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
15662025-03-08T00:40:01.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 28.57169ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15672025-03-08T00:40:01.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 72.511147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15682025-03-08T00:40:01.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 100.07094ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15692025-03-08T00:40:01.804ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 96.74845ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15702025-03-08T00:40:01.833ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 813.014186ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
15712025-03-08T00:40:01.858ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 173.452309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15722025-03-08T00:40:01.876ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 554.558988ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15732025-03-08T00:40:01.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 282.823137ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15742025-03-08T00:40:01.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 387.11684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15752025-03-08T00:40:01.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 216.524342ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15762025-03-08T00:40:02.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 656.02481ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
15772025-03-08T00:40:02.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.213903452s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
15782025-03-08T00:40:02.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 571.035853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15792025-03-08T00:40:02.120ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.030223257s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
15802025-03-08T00:40:02.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 470.684988ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15812025-03-08T00:40:02.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 248.324142ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15822025-03-08T00:40:02.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.312938225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
15832025-03-08T00:40:02.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.088583007s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
15842025-03-08T00:40:02.333ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 855.954837ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
15852025-03-08T00:40:02.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.366878303s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
15862025-03-08T00:40:02.432ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 731.580424ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
15872025-03-08T00:40:02.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 860.790682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
15882025-03-08T00:40:02.456ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 425.727934ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15892025-03-08T00:40:02.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 735.602605ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
15902025-03-08T00:40:02.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 956.616429ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
15912025-03-08T00:40:02.630ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 781.788395ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
15922025-03-08T00:40:02.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 400.055533ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
15932025-03-08T00:40:02.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.385426018s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
15942025-03-08T00:40:02.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 614.001228ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
15952025-03-08T00:40:02.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.212686751s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
15962025-03-08T00:40:02.700ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 559.736032ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
15972025-03-08T00:40:02.895ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 722.151415ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
15982025-03-08T00:40:02.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.414171981s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
15992025-03-08T00:40:03.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.363016536s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16002025-03-08T00:40:03.162ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.43507601s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16012025-03-08T00:40:03.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 903.52706ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16022025-03-08T00:40:03.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.044281758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16032025-03-08T00:40:03.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 635.969076ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16042025-03-08T00:40:03.269ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 660.2772ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
16052025-03-08T00:40:03.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.311808349s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16062025-03-08T00:40:03.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 824.426759ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16072025-03-08T00:40:03.317ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 710.530765ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16082025-03-08T00:40:03.423ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 875.990506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
16092025-03-08T00:40:03.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.026218209s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
16102025-03-08T00:40:03.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 672.512461ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16112025-03-08T00:40:03.582ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 669.578539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
16122025-03-08T00:40:03.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 1.126613561s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
16132025-03-08T00:40:03.767ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.117978388s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
16142025-03-08T00:40:03.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 686.163035ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16152025-03-08T00:40:03.911ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 882.38008ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16162025-03-08T00:40:03.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.363740209s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
16172025-03-08T00:40:04.038ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.138588554s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16182025-03-08T00:40:04.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 788.430095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16192025-03-08T00:40:04.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.418953922s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16202025-03-08T00:40:04.133ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.421704413s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16212025-03-08T00:40:04.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.288105912s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16222025-03-08T00:40:04.258ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.15741467s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16232025-03-08T00:40:04.266ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.240048234s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
16242025-03-08T00:40:04.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.354725459s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
16252025-03-08T00:40:04.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.118210406s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
16262025-03-08T00:40:04.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 742.343409ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16272025-03-08T00:40:04.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 765.656524ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
16282025-03-08T00:40:04.577ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 969.369488ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16292025-03-08T00:40:04.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 794.014347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16302025-03-08T00:40:04.610ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.195505484s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16312025-03-08T00:40:04.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 1.266138423s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
16322025-03-08T00:40:04.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 605.73962ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16332025-03-08T00:40:04.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.006504007s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16342025-03-08T00:40:04.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 530.314783ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
16352025-03-08T00:40:05.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 774.417498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16362025-03-08T00:40:05.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.409066595s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16372025-03-08T00:40:05.250ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 991.041629ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
16382025-03-08T00:40:05.313ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.491016425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
16392025-03-08T00:40:05.405ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.384830348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16402025-03-08T00:40:05.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.193079902s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16412025-03-08T00:40:05.426ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 625.84538ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16422025-03-08T00:40:05.434ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.319320622s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
16432025-03-08T00:40:05.455ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 862.339386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
16442025-03-08T00:40:05.515ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.332404454s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
16452025-03-08T00:40:05.523ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 647.711897ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16462025-03-08T00:40:05.545ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.357910725s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16472025-03-08T00:40:05.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 981.76909ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16482025-03-08T00:40:05.562ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 964.043088ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16492025-03-08T00:40:05.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.370491534s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
16502025-03-08T00:40:05.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 969.162079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16512025-03-08T00:40:05.870ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 847.500974ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16522025-03-08T00:40:05.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 821.056998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16532025-03-08T00:40:06.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 1.377754176s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
16542025-03-08T00:40:06.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 667.579263ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16552025-03-08T00:40:06.181ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 538.653518ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16562025-03-08T00:40:06.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.398171257s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
16572025-03-08T00:40:06.327ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.486795426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
16582025-03-08T00:40:06.536ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 516.30272ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16592025-03-08T00:40:06.546ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.356043734s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16602025-03-08T00:40:06.608ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.1506646s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16612025-03-08T00:40:06.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 603.023277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16622025-03-08T00:40:06.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.251818505s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16632025-03-08T00:40:06.736ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 520.956874ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16642025-03-08T00:40:06.747ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.450816952s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16652025-03-08T00:40:06.764ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.165876691s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
16662025-03-08T00:40:06.797ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 977.289476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16672025-03-08T00:40:06.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 631.302007ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16682025-03-08T00:40:06.816ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.194864099s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16692025-03-08T00:40:06.824ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.45448833s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
16702025-03-08T00:40:06.856ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 983.049031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
16712025-03-08T00:40:06.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 938.563949ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16722025-03-08T00:40:07.055ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.097667651s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
16732025-03-08T00:40:07.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 526.517511ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16742025-03-08T00:40:07.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 619.933334ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16752025-03-08T00:40:07.267ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 833.135979ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16762025-03-08T00:40:07.428ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 1.436440195s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
16772025-03-08T00:40:07.448ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.120904607s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16782025-03-08T00:40:07.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.308294526s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
16792025-03-08T00:40:07.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.185726502s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
16802025-03-08T00:40:07.770ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 928.362498ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16812025-03-08T00:40:07.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 547.145281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16822025-03-08T00:40:07.823ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.321343021s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
16832025-03-08T00:40:07.848ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.09648807s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
16842025-03-08T00:40:07.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 548.644317ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16852025-03-08T00:40:07.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.169827616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
16862025-03-08T00:40:07.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.350093951s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
16872025-03-08T00:40:07.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.369817192s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
16882025-03-08T00:40:07.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 598.71141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16892025-03-08T00:40:08.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.31208848s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
16902025-03-08T00:40:08.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.412403935s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
16912025-03-08T00:40:08.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.405080982s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
16922025-03-08T00:40:08.209ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.358349934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
16932025-03-08T00:40:08.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 660.636222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
16942025-03-08T00:40:08.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 645.482557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
16952025-03-08T00:40:08.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.020653367s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
16962025-03-08T00:40:08.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 532.688015ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
16972025-03-08T00:40:08.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 511.439406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
16982025-03-08T00:40:08.720ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 946.684544ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
16992025-03-08T00:40:08.857ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.036061776s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
17002025-03-08T00:40:08.875ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 592.443211ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17012025-03-08T00:40:08.920ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 597.868874ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17022025-03-08T00:40:08.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 753.932214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
17032025-03-08T00:40:08.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.259830372s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
17042025-03-08T00:40:09.002ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.373609897s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
17052025-03-08T00:40:09.048ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.356549694s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
17062025-03-08T00:40:09.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 666.363085ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17072025-03-08T00:40:09.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.354788931s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
17082025-03-08T00:40:09.153ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.058954812s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
17092025-03-08T00:40:09.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.155365427s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
17102025-03-08T00:40:09.320ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.404070949s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
17112025-03-08T00:40:09.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.272678158s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
17122025-03-08T00:40:09.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.048057208s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
17132025-03-08T00:40:09.477ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 651.181132ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17142025-03-08T00:40:09.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 998.525435ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17152025-03-08T00:40:09.539ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.303363555s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
17162025-03-08T00:40:09.578ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 877.29693ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
17172025-03-08T00:40:09.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 895.682834ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
17182025-03-08T00:40:09.676ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 791.042362ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
17192025-03-08T00:40:09.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.375259214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
17202025-03-08T00:40:09.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.261905726s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17212025-03-08T00:40:09.903ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 768.224804ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
17222025-03-08T00:40:10.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 752.395582ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17232025-03-08T00:40:10.221ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 676.14513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
17242025-03-08T00:40:10.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 689.751012ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
17252025-03-08T00:40:10.386ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.388127414s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
17262025-03-08T00:40:10.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 949.919063ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
17272025-03-08T00:40:10.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 518.269474ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
17282025-03-08T00:40:10.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 978.811317ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
17292025-03-08T00:40:10.478ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.465437133s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
17302025-03-08T00:40:10.491ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.089039082s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
17312025-03-08T00:40:10.492ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47023
17322025-03-08T00:40:10.551ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57813 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47023 req_id = 641e2f90-81fd-4bc6-8013-3404db2fe56e response_code = 200 uri = /baseboard
17332025-03-08T00:40:10.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.044412946s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
17342025-03-08T00:40:10.564ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.221161344s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17352025-03-08T00:40:10.571ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.399787282s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
17362025-03-08T00:40:10.625ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.280163613s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
17372025-03-08T00:40:10.680ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 633.536959ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
17382025-03-08T00:40:10.734ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.076509517s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
17392025-03-08T00:40:10.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 817.346346ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
17402025-03-08T00:40:10.899ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 827.056003ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17412025-03-08T00:40:10.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.055645755s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
17422025-03-08T00:40:10.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.135311167s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
17432025-03-08T00:40:10.964ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.227987975s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
17442025-03-08T00:40:11.081ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 636.54822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17452025-03-08T00:40:11.101ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.122076766s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
17462025-03-08T00:40:11.324ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.494700095s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
17472025-03-08T00:40:11.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.192568923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
17482025-03-08T00:40:11.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 534.727481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
17492025-03-08T00:40:11.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 766.115258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
17502025-03-08T00:40:11.609ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.022970863s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
17512025-03-08T00:40:11.678ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 732.831845ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
17522025-03-08T00:40:11.727ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 525.594082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17532025-03-08T00:40:11.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 588.990168ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17542025-03-08T00:40:11.784ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.024469022s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
17552025-03-08T00:40:11.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 776.209372ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17562025-03-08T00:40:11.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.010885065s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
17572025-03-08T00:40:11.875ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
17582025-03-08T00:40:11.876ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17592025-03-08T00:40:11.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.349001383s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
17602025-03-08T00:40:11.954ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.16685574s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
17612025-03-08T00:40:11.972ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.186401579s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
17622025-03-08T00:40:11.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.245940606s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
17632025-03-08T00:40:11.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 985.36437ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
17642025-03-08T00:40:12.060ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 29.520947ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17652025-03-08T00:40:12.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 1.419538444s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
17662025-03-08T00:40:12.098ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 93.618297ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17672025-03-08T00:40:12.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.430103772s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
17682025-03-08T00:40:12.211ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 196.180405ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17692025-03-08T00:40:12.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 795.031203ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
17702025-03-08T00:40:12.262ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 610.362378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17712025-03-08T00:40:12.337ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 1.427099929s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17722025-03-08T00:40:12.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.133206731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
17732025-03-08T00:40:12.420ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 466.928796ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17742025-03-08T00:40:12.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.292614225s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
17752025-03-08T00:40:12.585ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 941.671419ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
17762025-03-08T00:40:12.613ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.175849557s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17772025-03-08T00:40:12.653ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.211428699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
17782025-03-08T00:40:12.828ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.188464975s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
17792025-03-08T00:40:12.847ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.301680542s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
17802025-03-08T00:40:12.865ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.339087563s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
17812025-03-08T00:40:12.889ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 678.019886ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17822025-03-08T00:40:12.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 734.971803ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17832025-03-08T00:40:13.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.21933026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
17842025-03-08T00:40:13.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.343508333s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
17852025-03-08T00:40:13.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.328366415s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
17862025-03-08T00:40:13.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.017159938s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
17872025-03-08T00:40:13.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.439947267s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
17882025-03-08T00:40:13.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 640.141181ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
17892025-03-08T00:40:13.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 899.461156ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
17902025-03-08T00:40:13.558ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.015031103s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
17912025-03-08T00:40:13.592ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.389792916s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
17922025-03-08T00:40:13.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.254451688s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
17932025-03-08T00:40:13.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 865.053131ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
17942025-03-08T00:40:13.673ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 1.321989592s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
17952025-03-08T00:40:13.748ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 565.188852ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
17962025-03-08T00:40:13.787ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 759.435303ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
17972025-03-08T00:40:13.812ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 953.425211ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
17982025-03-08T00:40:13.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 547.55405ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
17992025-03-08T00:40:13.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.369703744s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18002025-03-08T00:40:14.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 728.426091ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
18012025-03-08T00:40:14.169ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 595.346425ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18022025-03-08T00:40:14.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 579.04224ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
18032025-03-08T00:40:14.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 711.708897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
18042025-03-08T00:40:14.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 824.836173ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
18052025-03-08T00:40:14.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 647.74263ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
18062025-03-08T00:40:14.359ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
18072025-03-08T00:40:14.378ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
18082025-03-08T00:40:14.390ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
18092025-03-08T00:40:14.394ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
18102025-03-08T00:40:14.413ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.101849414s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
18112025-03-08T00:40:14.438ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 989.323214ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
18122025-03-08T00:40:14.454ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.32152052s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
18132025-03-08T00:40:14.489ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 930.550935ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18142025-03-08T00:40:14.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.212523427s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18152025-03-08T00:40:14.565ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 680.173541ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18162025-03-08T00:40:14.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 1.249946783s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18172025-03-08T00:40:14.708ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.493825048s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
18182025-03-08T00:40:14.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 661.367926ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18192025-03-08T00:40:14.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 1.324369322s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
18202025-03-08T00:40:14.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.286135456s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
18212025-03-08T00:40:14.822ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.277270618s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
18222025-03-08T00:40:14.883ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.178675918s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
18232025-03-08T00:40:14.978ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.265050369s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
18242025-03-08T00:40:14.996ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 501.359932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
18252025-03-08T00:40:15.010ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 1.267279211s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18262025-03-08T00:40:15.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.214677219s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
18272025-03-08T00:40:15.115ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.052726968s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
18282025-03-08T00:40:15.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 921.827819ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18292025-03-08T00:40:15.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 872.630952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18302025-03-08T00:40:15.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 747.718018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18312025-03-08T00:40:15.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 803.989331ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
18322025-03-08T00:40:15.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.075072391s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18332025-03-08T00:40:15.509ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 1.081174175s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
18342025-03-08T00:40:15.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 635.051675ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
18352025-03-08T00:40:15.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 850.529086ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18362025-03-08T00:40:15.786ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 758.214904ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
18372025-03-08T00:40:15.850ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 919.777183ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18382025-03-08T00:40:16.073ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec") failed: Property not found. retry in 1.232708746s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
18392025-03-08T00:40:16.104ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.360474118s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
18402025-03-08T00:40:16.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072") failed: Property not found. retry in 1.014534787s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
18412025-03-08T00:40:16.129ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331") failed: Property not found. retry in 968.122598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
18422025-03-08T00:40:16.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.238261746s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
18432025-03-08T00:40:16.183ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 895.589067ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
18442025-03-08T00:40:16.196ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 595.938936ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18452025-03-08T00:40:16.207ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 856.007015ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18462025-03-08T00:40:16.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 569.043176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18472025-03-08T00:40:16.224ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 895.857925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
18482025-03-08T00:40:16.251ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f") failed: Property not found. retry in 1.000793486s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
18492025-03-08T00:40:16.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1") failed: Property not found. retry in 1.239174735s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
18502025-03-08T00:40:16.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 701.880948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
18512025-03-08T00:40:16.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 998.052651ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18522025-03-08T00:40:16.540ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 1.072667864s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18532025-03-08T00:40:16.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b") failed: Property not found. retry in 1.020004881s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
18542025-03-08T00:40:16.609ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d") failed: Property not found. retry in 651.287616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
18552025-03-08T00:40:16.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 770.53693ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18562025-03-08T00:40:16.781ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 857.98065ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18572025-03-08T00:40:16.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 519.091928ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18582025-03-08T00:40:16.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 709.125964ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18592025-03-08T00:40:16.982ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c") failed: Property not found. retry in 505.755228ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
18602025-03-08T00:40:17.075ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 1.098646157s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18612025-03-08T00:40:17.090ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69") failed: Property not found. retry in 1.279526412s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
18622025-03-08T00:40:17.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88") failed: Property not found. retry in 1.206623659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
18632025-03-08T00:40:17.298ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 733.141591ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18642025-03-08T00:40:17.331ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 847.803117ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18652025-03-08T00:40:17.407ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.170323945s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18662025-03-08T00:40:17.422ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8") failed: Property not found. retry in 1.088619975s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
18672025-03-08T00:40:17.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec") failed: Property not found. retry in 1.252496465s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
18682025-03-08T00:40:17.634ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 610.097718ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18692025-03-08T00:40:17.643ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a") failed: Property not found. retry in 834.889261ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18702025-03-08T00:40:17.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 918.762811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18712025-03-08T00:40:18.045ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 640.738437ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18722025-03-08T00:40:18.190ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824") failed: Property not found. retry in 994.833881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18732025-03-08T00:40:18.201ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 591.970714ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18742025-03-08T00:40:18.261ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d") failed: Property not found. retry in 993.9015ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18752025-03-08T00:40:18.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5") failed: Property not found. retry in 565.269051ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18762025-03-08T00:40:18.601ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737") failed: Property not found. retry in 1.458301598s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18772025-03-08T00:40:18.703ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 886.426787ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18782025-03-08T00:40:18.814ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e") failed: Property not found. retry in 1.012770118s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
18792025-03-08T00:40:19.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 1.204649618s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18802025-03-08T00:40:20.836ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 1.471213518s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18812025-03-08T00:40:22.319ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98") failed: Property not found. retry in 740.66491ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18822025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_196d75e7-fd8a-4aaa-abde-011428769331
18832025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_69ed853c-dd53-42e9-b823-c309b1721af5
18842025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_68e186b9-4e79-4c69-aca1-ca0f5c04390b
18852025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_a4314bb8-ec23-42c2-8b82-e7f3905c6dec
18862025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_8ad592e3-df9b-4fc1-8dc0-dbca7c7df7d1
18872025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_1176eac2-12ea-4684-a2d7-4423954b6e69
18882025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_841ee309-4e1e-443f-ae06-2ad5eb454a8d
18892025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_59287b7e-0d61-4586-b7c5-e79476927737
18902025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_4d603338-4154-45db-a26b-b6679dc7f0ec
18912025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_oximeter_c5a56912-50aa-493d-9612-f426cf7f1072
18922025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_b62ddf05-bf70-4650-8e3f-845847751e88
18932025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_25a40df9-fd80-42f0-adc4-b4dff511e53d
18942025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_b342cde1-1872-419c-825e-6ba9793c6da8
18952025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_clickhouse_ced54ff7-02b2-4342-ba41-ce79c4f2bc98
18962025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_8300c829-49f9-4839-892a-078272d50f4c
18972025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_0c6794b6-6250-42cb-8b59-71e901b7e824
18982025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_da0d8428-046e-431d-9a82-470b80ca232a
18992025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_2de3e77c-d783-4b91-be44-cced0891ce8e
19002025-03-08T00:40:23.090ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_8b94fb8b-b81f-40e3-a7d8-ae559205ae7f
19012025-03-08T00:40:23.091ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
19022025-03-08T00:40:23.096ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
19032025-03-08T00:40:23.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42698072 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45332 req_id = 40fc559f-1660-4284-b48d-ab1f132e52c9 response_code = 204 uri = /omicron-zones
19042025-03-08T00:40:23.108ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1468
19052025-03-08T00:40:23.113ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:857
19062025-03-08T00:40:23.114ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:870
19072025-03-08T00:40:23.157ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1070
19082025-03-08T00:40:23.159ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19092025-03-08T00:40:23.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19102025-03-08T00:40:23.376ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19112025-03-08T00:40:23.460ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19122025-03-08T00:40:23.616ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19132025-03-08T00:40:23.724ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19142025-03-08T00:40:23.980ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19152025-03-08T00:40:24.389ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19162025-03-08T00:40:24.779ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19172025-03-08T00:40:25.387ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/533106a5-4f1c-4a48-aa36-2a30759fbe03/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
19182025-03-08T00:40:26.558ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/87826585-0843-40d2-a3ce-382fa54dbc5c) file = sled-agent/src/probe_manager.rs:234 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
19192025-03-08T00:40:27.426ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2fc721d6-fde3-420e-8e18-c6edefe6dcda", "content-length": "173", "date": "Sat, 08 Mar 2025 00:40:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"533106a5-4f1c-4a48-aa36-2a30759fbe03\"", request_id: "2fc721d6-fde3-420e-8e18-c6edefe6dcda" } file = sled-agent/src/rack_setup/service.rs:1132
19202025-03-08T00:40:28.355ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "774e6ec7-dc63-4f9f-b797-8f0edc5c9573", "content-length": "173", "date": "Sat, 08 Mar 2025 00:40:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"533106a5-4f1c-4a48-aa36-2a30759fbe03\"", request_id: "774e6ec7-dc63-4f9f-b797-8f0edc5c9573" } file = sled-agent/src/rack_setup/service.rs:1132
19212025-03-08T00:40:29.284ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
19222025-03-08T00:40:29.419ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d6309b59-53b8-487c-9ac8-57814056ab61", "content-length": "173", "date": "Sat, 08 Mar 2025 00:40:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"533106a5-4f1c-4a48-aa36-2a30759fbe03\"", request_id: "d6309b59-53b8-487c-9ac8-57814056ab61" } file = sled-agent/src/rack_setup/service.rs:1132
19232025-03-08T00:40:30.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48804
19242025-03-08T00:40:30.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19252025-03-08T00:40:30.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48804 req_id = 7b4a769e-5160-46eb-863d-258f7c643f11 response_code = 200 uri = /artifacts
19262025-03-08T00:40:30.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33136
19272025-03-08T00:40:30.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33136 req_id = 52e59e41-cd37-4982-973d-b9a3463322ac response_code = 200 uri = /vpc-routes
19282025-03-08T00:40:30.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32820
19292025-03-08T00:40:30.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32820 req_id = 722f7c33-0afe-4176-b1bb-7230e91f625d response_code = 200 uri = /vpc-routes
19302025-03-08T00:40:30.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46271
19312025-03-08T00:40:30.815ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19322025-03-08T00:40:30.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46271 req_id = 2d5f3a82-1164-456d-9c28-6da003f31196 response_code = 200 uri = /artifacts
19332025-03-08T00:40:30.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37482
19342025-03-08T00:40:30.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19352025-03-08T00:40:30.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19362025-03-08T00:40:30.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
19372025-03-08T00:40:30.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
19382025-03-08T00:40:30.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19392025-03-08T00:40:30.849ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
19402025-03-08T00:40:30.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52137
19412025-03-08T00:40:30.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19422025-03-08T00:40:30.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19432025-03-08T00:40:30.872ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
19442025-03-08T00:40:30.873ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
19452025-03-08T00:40:30.881ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19462025-03-08T00:40:30.881ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
19472025-03-08T00:40:30.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
19482025-03-08T00:40:30.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33136 req_id = d76ada55-ad72-4164-b6b4-a87b0aee7578 response_code = 204 uri = /eip-gateways
19492025-03-08T00:40:30.901ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19502025-03-08T00:40:30.901ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
19512025-03-08T00:40:30.917ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19522025-03-08T00:40:30.920ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
19532025-03-08T00:40:30.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
19542025-03-08T00:40:30.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4625 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32820 req_id = bc727d12-d86a-4216-bc8b-af57d8dc7ba5 response_code = 204 uri = /eip-gateways
19552025-03-08T00:40:30.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38544
19562025-03-08T00:40:30.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38544 req_id = aac7ee09-f36b-4fa4-86ee-9b8c47b85ec1 response_code = 200 uri = /vpc-routes
19572025-03-08T00:40:30.936ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19582025-03-08T00:40:30.936ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
19592025-03-08T00:40:30.965ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19602025-03-08T00:40:30.965ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
19612025-03-08T00:40:30.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19622025-03-08T00:40:30.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
19632025-03-08T00:40:30.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49398
19642025-03-08T00:40:30.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49398 req_id = 4755e54a-6c7b-4a09-8845-dca95fb6c348 response_code = 200 uri = /v2p
19652025-03-08T00:40:30.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61034
19662025-03-08T00:40:30.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61034 req_id = aa18c12c-ecad-4366-b036-ea56e8463676 response_code = 200 uri = /v2p
19672025-03-08T00:40:31.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44819
19682025-03-08T00:40:31.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19692025-03-08T00:40:31.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
19702025-03-08T00:40:31.025ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19712025-03-08T00:40:31.026ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19722025-03-08T00:40:31.026ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
19732025-03-08T00:40:31.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44819 req_id = 1b993d25-f96a-412b-809a-40a79cdff903 response_code = 200 uri = /artifacts
19742025-03-08T00:40:31.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
19752025-03-08T00:40:31.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38544 req_id = 111d1b60-1e08-43e1-b46f-24a4c559caad response_code = 204 uri = /eip-gateways
19762025-03-08T00:40:31.050ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19772025-03-08T00:40:31.050ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
19782025-03-08T00:40:31.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19792025-03-08T00:40:31.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
19802025-03-08T00:40:31.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44981
19812025-03-08T00:40:31.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19822025-03-08T00:40:31.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19832025-03-08T00:40:31.089ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19842025-03-08T00:40:31.089ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
19852025-03-08T00:40:31.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5609 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33136 req_id = a607413a-bbd9-4ce8-8c2d-01aaed901fae response_code = 204 uri = /vpc-routes
19862025-03-08T00:40:31.106ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
19872025-03-08T00:40:31.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19882025-03-08T00:40:31.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
19892025-03-08T00:40:31.115ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
19902025-03-08T00:40:31.129ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19912025-03-08T00:40:31.129ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
19922025-03-08T00:40:31.135ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19932025-03-08T00:40:31.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 763 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32820 req_id = bcd08bbd-65bc-4ea1-a6c7-39378242fd90 response_code = 204 uri = /vpc-routes
19942025-03-08T00:40:31.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19952025-03-08T00:40:31.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
19962025-03-08T00:40:31.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34902
19972025-03-08T00:40:31.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34902 req_id = d4366b66-b62c-4e4a-9d04-57a872e070fd response_code = 200 uri = /v2p
19982025-03-08T00:40:31.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19992025-03-08T00:40:31.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
20002025-03-08T00:40:31.190ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20012025-03-08T00:40:31.190ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
20022025-03-08T00:40:31.205ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20032025-03-08T00:40:31.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
20042025-03-08T00:40:31.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20052025-03-08T00:40:31.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
20062025-03-08T00:40:31.241ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20072025-03-08T00:40:31.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
20082025-03-08T00:40:31.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20092025-03-08T00:40:31.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
20102025-03-08T00:40:31.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 435045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37482 req_id = 7ddc9e72-301b-4995-ae2d-d20bf99400fd response_code = 200 uri = /inventory
20112025-03-08T00:40:31.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20122025-03-08T00:40:31.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
20132025-03-08T00:40:31.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 429816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52137 req_id = bda9e6e5-0744-4f1d-9baf-9279b76cd21a response_code = 200 uri = /inventory
20142025-03-08T00:40:31.308ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20152025-03-08T00:40:31.308ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
20162025-03-08T00:40:31.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20172025-03-08T00:40:31.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
20182025-03-08T00:40:31.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20192025-03-08T00:40:31.364ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
20202025-03-08T00:40:31.370ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
20212025-03-08T00:40:31.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38544 req_id = e19b7787-a3b7-462c-a00a-63a13d98c9bb response_code = 204 uri = /vpc-routes
20222025-03-08T00:40:31.389ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20232025-03-08T00:40:31.389ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
20242025-03-08T00:40:31.414ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20252025-03-08T00:40:31.414ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
20262025-03-08T00:40:31.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 352304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44981 req_id = d99bee2e-0ca1-46d2-b7bc-d6a6519488fe response_code = 200 uri = /inventory
20272025-03-08T00:40:32.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46800
20282025-03-08T00:40:32.519ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20292025-03-08T00:40:32.519ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20302025-03-08T00:40:32.519ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
20312025-03-08T00:40:32.519ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
20322025-03-08T00:40:32.531ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20332025-03-08T00:40:32.531ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
20342025-03-08T00:40:32.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20352025-03-08T00:40:32.558ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
20362025-03-08T00:40:32.583ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20372025-03-08T00:40:32.583ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
20382025-03-08T00:40:32.608ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20392025-03-08T00:40:32.608ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
20402025-03-08T00:40:32.634ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20412025-03-08T00:40:32.634ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
20422025-03-08T00:40:32.659ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20432025-03-08T00:40:32.659ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
20442025-03-08T00:40:32.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20452025-03-08T00:40:32.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
20462025-03-08T00:40:32.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20472025-03-08T00:40:32.705ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
20482025-03-08T00:40:32.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39218
20492025-03-08T00:40:32.722ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20502025-03-08T00:40:32.722ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20512025-03-08T00:40:32.722ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20522025-03-08T00:40:32.722ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20532025-03-08T00:40:32.722ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
20542025-03-08T00:40:32.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20552025-03-08T00:40:32.723ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20562025-03-08T00:40:32.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39218 req_id = 8a03b7dc-d115-4f19-9c5d-9951a749bd64 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20572025-03-08T00:40:32.724ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1142
20582025-03-08T00:40:32.728ZINFOSledAgent (RSS): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
20592025-03-08T00:40:32.728ZINFOSledAgent (RSS): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
20602025-03-08T00:40:32.729ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20612025-03-08T00:40:32.729ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
20622025-03-08T00:40:32.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 225658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46800 req_id = 3fa8f79c-4383-44d1-b8ee-3d5013007443 response_code = 200 uri = /inventory
20632025-03-08T00:40:33.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63527
20642025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20652025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20662025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20672025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20682025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
20692025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20702025-03-08T00:40:33.058ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20712025-03-08T00:40:33.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63527 req_id = 58fbd6b2-d089-4e6f-8faf-f94b22c8e2c7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20722025-03-08T00:40:33.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46157
20732025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20742025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20752025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20762025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20772025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
20782025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20792025-03-08T00:40:33.357ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20802025-03-08T00:40:33.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46157 req_id = 25f37c0c-fa95-4ebc-9a0d-32ef89da1341 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20812025-03-08T00:40:33.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53825
20822025-03-08T00:40:33.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20832025-03-08T00:40:33.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20842025-03-08T00:40:33.409ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
20852025-03-08T00:40:33.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
20862025-03-08T00:40:33.421ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20872025-03-08T00:40:33.421ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
20882025-03-08T00:40:33.446ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20892025-03-08T00:40:33.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
20902025-03-08T00:40:33.469ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20912025-03-08T00:40:33.469ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
20922025-03-08T00:40:33.490ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20932025-03-08T00:40:33.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
20942025-03-08T00:40:33.513ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20952025-03-08T00:40:33.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
20962025-03-08T00:40:33.536ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20972025-03-08T00:40:33.536ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
20982025-03-08T00:40:33.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20992025-03-08T00:40:33.558ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
21002025-03-08T00:40:33.584ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21012025-03-08T00:40:33.584ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
21022025-03-08T00:40:33.608ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21032025-03-08T00:40:33.608ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
21042025-03-08T00:40:33.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53825 req_id = 8a89b86d-ca79-400f-bf42-991e47411d83 response_code = 200 uri = /inventory
21052025-03-08T00:40:34.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61554
21062025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21072025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21082025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21092025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21102025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
21112025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21122025-03-08T00:40:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21132025-03-08T00:40:34.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61554 req_id = fc7eef90-06d8-4991-8bf8-c27abf59cacb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21142025-03-08T00:40:40.593ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41422
21152025-03-08T00:40:40.593ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41422 req_id = 2e945b67-203b-4b49-b1d9-74918d1e8d6a response_code = 200 uri = /baseboard
21162025-03-08T00:40:42.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62149
21172025-03-08T00:40:42.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62149 req_id = 5b595a58-ce92-41d7-92d3-e36893e54fd2 response_code = 200 uri = /vpc-routes
21182025-03-08T00:40:42.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21192025-03-08T00:40:42.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62149 req_id = 5b0aeefd-a96e-4c84-8a47-b41e7db06193 response_code = 204 uri = /eip-gateways
21202025-03-08T00:40:42.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62149 req_id = 9a2afd67-655a-405b-a498-473957bc5ea0 response_code = 204 uri = /vpc-routes
21212025-03-08T00:41:00.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49758
21222025-03-08T00:41:00.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49758 req_id = 45578510-43a7-405d-8798-bf41b3797ef9 response_code = 200 uri = /vpc-routes
21232025-03-08T00:41:00.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38150
21242025-03-08T00:41:00.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38150 req_id = 666d04cd-ac8d-4e4f-981b-5aba77e0c9f6 response_code = 200 uri = /vpc-routes
21252025-03-08T00:41:00.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21262025-03-08T00:41:00.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49758 req_id = a8406a76-a513-42e8-ab9f-e54bcb95435c response_code = 204 uri = /eip-gateways
21272025-03-08T00:41:00.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49758 req_id = d47dd952-4f3b-4a75-b622-9eddb9501327 response_code = 204 uri = /vpc-routes
21282025-03-08T00:41:00.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21292025-03-08T00:41:00.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38150 req_id = 9595a2f4-212e-4902-a04b-0751cfa48368 response_code = 204 uri = /eip-gateways
21302025-03-08T00:41:00.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38150 req_id = fb884b05-58d6-4893-93f9-dc6887ffdd9d response_code = 204 uri = /vpc-routes
21312025-03-08T00:41:00.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65118
21322025-03-08T00:41:00.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65118 req_id = ecd7d5dc-efae-46a8-8c49-36f6dd300e7d response_code = 200 uri = /v2p
21332025-03-08T00:41:00.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56520
21342025-03-08T00:41:00.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56520 req_id = 8709e47c-9680-4b0a-98d5-d4ad61796a90 response_code = 200 uri = /v2p
21352025-03-08T00:41:00.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59509
21362025-03-08T00:41:00.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59509 req_id = 4d01b6b5-8497-4305-b673-cdfeeaadaf02 response_code = 200 uri = /vpc-routes
21372025-03-08T00:41:00.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33029
21382025-03-08T00:41:00.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21392025-03-08T00:41:00.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21402025-03-08T00:41:01.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33029 req_id = 9f03ea71-fbef-44b8-8aa2-4910bfc36609 response_code = 204 uri = /switch-ports
21412025-03-08T00:41:01.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57215
21422025-03-08T00:41:01.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21432025-03-08T00:41:01.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59509 req_id = 77f51204-f580-42b2-a39e-9990c9be211a response_code = 204 uri = /eip-gateways
21442025-03-08T00:41:01.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38844
21452025-03-08T00:41:01.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21462025-03-08T00:41:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38844 req_id = 356505df-3b1c-4275-abf8-0cf1632536bc response_code = 200 uri = /v2p
21472025-03-08T00:41:01.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5571 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33029 req_id = 212920f7-c7bf-47ec-b24e-19fc4f2d4d51 response_code = 200 uri = /network-bootstore-config
21482025-03-08T00:41:01.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21492025-03-08T00:41:01.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43402
21502025-03-08T00:41:01.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21512025-03-08T00:41:01.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57215 req_id = ed93a0f9-c122-4506-a771-435452c7dcc7 response_code = 204 uri = /switch-ports
21522025-03-08T00:41:01.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57215 req_id = c9b91152-0ef5-4029-a88b-5ee7605d4c05 response_code = 200 uri = /network-bootstore-config
21532025-03-08T00:41:01.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59509 req_id = eff6f179-bd25-4334-9366-aef2c02612ae response_code = 204 uri = /vpc-routes
21542025-03-08T00:41:01.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21552025-03-08T00:41:01.168ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
21562025-03-08T00:41:01.168ZINFOSledAgent (bootstore): Writing ledger to /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
21572025-03-08T00:41:01.169ZINFOSledAgent (bootstore): Writing ledger to /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-sock-i86pc
21582025-03-08T00:41:01.170ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
21592025-03-08T00:41:01.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3749 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33029 req_id = 4cac1299-d5dc-4f75-b9a5-dd2d12117d16 response_code = 204 uri = /network-bootstore-config
21602025-03-08T00:41:01.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43402 req_id = 1bdf8687-f290-412f-ad5f-5638da612e6c response_code = 204 uri = /switch-ports
21612025-03-08T00:41:01.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43402 req_id = f7b7a0a7-f300-4bc2-ba50-9f3661f04699 response_code = 200 uri = /network-bootstore-config
21622025-03-08T00:41:10.627ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61766
21632025-03-08T00:41:10.627ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61766 req_id = 180bf8cf-771a-4db6-8e16-c1320d9d11a5 response_code = 200 uri = /baseboard
21642025-03-08T00:41:14.353ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
21652025-03-08T00:41:14.354ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
21662025-03-08T00:41:14.354ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
21672025-03-08T00:41:14.354ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
21682025-03-08T00:41:30.304ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
21692025-03-08T00:41:30.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48962
21702025-03-08T00:41:30.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48962 req_id = aedbf7fe-7a7c-4295-9ebe-de90c567fe6f response_code = 200 uri = /v2p
21712025-03-08T00:41:30.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38220
21722025-03-08T00:41:30.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38220 req_id = 853bcc13-074d-41f2-9f3a-0a334b120c0a response_code = 200 uri = /vpc-routes
21732025-03-08T00:41:30.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33762
21742025-03-08T00:41:30.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33762 req_id = 25daaa4a-f9c3-4673-a589-47974cc6ba23 response_code = 200 uri = /vpc-routes
21752025-03-08T00:41:30.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21762025-03-08T00:41:30.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33762 req_id = 384fab9e-49cc-45bf-81d3-630bc9bb78c6 response_code = 204 uri = /eip-gateways
21772025-03-08T00:41:30.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21782025-03-08T00:41:30.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38220 req_id = 1513ee07-0d31-42af-ab51-735d2ee2ddfd response_code = 204 uri = /eip-gateways
21792025-03-08T00:41:30.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38220 req_id = a42ee356-b455-48ff-ac32-48805873dde7 response_code = 204 uri = /vpc-routes
21802025-03-08T00:41:30.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33762 req_id = d18fbf0b-2e3a-4e55-ae52-017332e6ce55 response_code = 204 uri = /vpc-routes
21812025-03-08T00:41:30.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39678
21822025-03-08T00:41:30.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39678 req_id = a74084fa-04e1-4193-bbb9-ae35758095ea response_code = 200 uri = /vpc-routes
21832025-03-08T00:41:30.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57598
21842025-03-08T00:41:30.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21852025-03-08T00:41:30.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21862025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57598 req_id = 24c26132-339e-4c73-bbab-b67f2c7c2c24 response_code = 204 uri = /switch-ports
21872025-03-08T00:41:31.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
21882025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43323
21892025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39678 req_id = 5f1b6250-386b-477e-9dd0-4e7529396e0d response_code = 204 uri = /eip-gateways
21902025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61438
21912025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57598 req_id = db4fe1b7-fb46-45bd-a038-a919f0f260f7 response_code = 200 uri = /network-bootstore-config
21922025-03-08T00:41:31.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43323 req_id = 6f15b739-a565-4372-a522-e37783a2702f response_code = 200 uri = /v2p
21932025-03-08T00:41:31.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21942025-03-08T00:41:31.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39678 req_id = 244deef1-dab4-427a-9532-6eb6c79fd40e response_code = 204 uri = /vpc-routes
21952025-03-08T00:41:31.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21962025-03-08T00:41:31.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52676
21972025-03-08T00:41:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52676 req_id = ffbb0438-49ef-45f3-bb20-f2b39b9da385 response_code = 200 uri = /v2p
21982025-03-08T00:41:31.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61438 req_id = be82dce2-5a7a-4ef8-a220-7f68bb33315a response_code = 204 uri = /switch-ports
21992025-03-08T00:41:31.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61438 req_id = 5602ed85-224c-497a-99bd-42fe365e533d response_code = 200 uri = /network-bootstore-config
22002025-03-08T00:41:31.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51736
22012025-03-08T00:41:31.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22022025-03-08T00:41:31.394ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22032025-03-08T00:41:31.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51736 req_id = 10a0cbe0-8b23-4a99-82fa-49b0981202ac response_code = 204 uri = /switch-ports
22042025-03-08T00:41:31.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51736 req_id = ef58aa0b-cbf7-4399-ac07-86560b8f968e response_code = 200 uri = /network-bootstore-config
22052025-03-08T00:41:40.662ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64149
22062025-03-08T00:41:40.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64149 req_id = fda2abd7-2ac4-426c-b192-033fe79ad21b response_code = 200 uri = /baseboard
22072025-03-08T00:41:42.653ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:39407 remote_addr = [fd00:1122:3344:101::d]:59267 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
22082025-03-08T00:41:42.681ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 27505 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 124836e7-8e52-4d35-8dbe-16a1bd4cca27 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
22092025-03-08T00:42:00.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36162
22102025-03-08T00:42:00.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36162 req_id = 660ce89e-8a8f-48d8-bff3-35f5c8fb0ce5 response_code = 200 uri = /vpc-routes
22112025-03-08T00:42:00.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22122025-03-08T00:42:00.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36162 req_id = 8b0fe5ee-d1a2-4647-ac4d-8fb5291a9be0 response_code = 204 uri = /eip-gateways
22132025-03-08T00:42:00.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36162 req_id = ef1b6e16-7a43-4fc7-a0af-e41e35cca7c5 response_code = 204 uri = /vpc-routes
22142025-03-08T00:42:00.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38273
22152025-03-08T00:42:00.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38273 req_id = 7349b4ec-70bc-46bf-a3dd-3eb7925ce6bc response_code = 200 uri = /vpc-routes
22162025-03-08T00:42:00.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22172025-03-08T00:42:00.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38273 req_id = 6148dae1-a59a-48fb-9992-c66504e62b55 response_code = 204 uri = /eip-gateways
22182025-03-08T00:42:00.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37282
22192025-03-08T00:42:00.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37282 req_id = 08453a01-da62-4307-83a0-030eb689168d response_code = 200 uri = /v2p
22202025-03-08T00:42:00.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38273 req_id = 5fedff1c-a289-4fa0-850f-3fed6820c885 response_code = 204 uri = /vpc-routes
22212025-03-08T00:42:00.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52514
22222025-03-08T00:42:00.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22232025-03-08T00:42:00.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22242025-03-08T00:42:00.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52514 req_id = fb73971f-1d03-4344-bcb7-c0d526a73644 response_code = 204 uri = /switch-ports
22252025-03-08T00:42:00.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60969
22262025-03-08T00:42:00.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60969 req_id = 8ac7aba2-992b-4c3e-85bc-1708272a35a0 response_code = 200 uri = /v2p
22272025-03-08T00:42:00.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52514 req_id = 98ce4221-cd1a-4830-aa26-2b3ed17eacb3 response_code = 200 uri = /network-bootstore-config
22282025-03-08T00:42:00.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37735
22292025-03-08T00:42:00.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37735 req_id = 8151cbe8-965b-421c-b1b8-4867eb7b7de1 response_code = 200 uri = /vpc-routes
22302025-03-08T00:42:00.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22312025-03-08T00:42:00.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37735 req_id = 504ffd43-7d0c-4d99-bbc3-c13ba9b9137c response_code = 204 uri = /eip-gateways
22322025-03-08T00:42:00.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60236
22332025-03-08T00:42:00.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22342025-03-08T00:42:00.950ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22352025-03-08T00:42:01.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60236 req_id = 66af21ee-dceb-4e75-9193-7e3131797a67 response_code = 204 uri = /switch-ports
22362025-03-08T00:42:01.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33145
22372025-03-08T00:42:01.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60236 req_id = 3ce941b5-2f14-4f76-9b43-93ee854b021c response_code = 200 uri = /network-bootstore-config
22382025-03-08T00:42:01.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33145 req_id = f63018e6-0933-4a0b-9248-fd4b54871406 response_code = 200 uri = /v2p
22392025-03-08T00:42:01.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37735 req_id = 6cdf8cde-2f6f-4172-bc3b-4cb9ba8b29df response_code = 204 uri = /vpc-routes
22402025-03-08T00:42:01.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59154
22412025-03-08T00:42:01.064ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22422025-03-08T00:42:01.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22432025-03-08T00:42:01.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59154 req_id = f72a32c8-265c-42ba-8c1c-7e857b61d70e response_code = 204 uri = /switch-ports
22442025-03-08T00:42:01.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59154 req_id = 90bc50bb-b099-4e82-bb7f-9ec108c537d8 response_code = 200 uri = /network-bootstore-config
22452025-03-08T00:42:10.699ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46241
22462025-03-08T00:42:10.699ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46241 req_id = 241bc05f-e272-4bfa-900c-861b1cfb36e6 response_code = 200 uri = /baseboard
22472025-03-08T00:42:12.661ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8483 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 9a91c02a-0be7-48be-bd3e-580c21dd2ee9 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
22482025-03-08T00:42:14.353ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
22492025-03-08T00:42:14.353ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
22502025-03-08T00:42:14.353ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
22512025-03-08T00:42:14.354ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
22522025-03-08T00:42:30.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32845
22532025-03-08T00:42:30.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32845 req_id = 0421d586-afff-4245-9bd9-e7c37aa07ae2 response_code = 200 uri = /vpc-routes
22542025-03-08T00:42:30.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57868
22552025-03-08T00:42:30.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57868 req_id = 4ecb0a46-aca6-4455-97b9-f7009d7ba0cf response_code = 200 uri = /v2p
22562025-03-08T00:42:30.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52949
22572025-03-08T00:42:30.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52949 req_id = 9246b035-a337-4e9f-ac1b-dfb984bf0775 response_code = 200 uri = /vpc-routes
22582025-03-08T00:42:30.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22592025-03-08T00:42:30.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32845 req_id = abe572c4-19d9-45a1-a412-155dc3241bc0 response_code = 204 uri = /eip-gateways
22602025-03-08T00:42:30.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32845 req_id = 79d2b044-7aab-40aa-bd0c-a20e7642e76d response_code = 204 uri = /vpc-routes
22612025-03-08T00:42:30.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22622025-03-08T00:42:30.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52949 req_id = f65ab74f-59e7-4ffb-8d23-5cc841415249 response_code = 204 uri = /eip-gateways
22632025-03-08T00:42:30.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52949 req_id = 2f8cb69b-08e8-426c-9c86-5c4653414ceb response_code = 204 uri = /vpc-routes
22642025-03-08T00:42:30.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34837
22652025-03-08T00:42:30.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34837 req_id = 2554ae4a-5165-4fb7-b0cf-26171c60f493 response_code = 200 uri = /v2p
22662025-03-08T00:42:30.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59873
22672025-03-08T00:42:30.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22682025-03-08T00:42:30.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22692025-03-08T00:42:31.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59873 req_id = b8fbe3ad-ed5b-4702-a955-c2e1a23c2fcc response_code = 204 uri = /switch-ports
22702025-03-08T00:42:31.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63929
22712025-03-08T00:42:31.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22722025-03-08T00:42:31.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59873 req_id = 8873215d-369b-417b-b841-8aed4e7a5f1f response_code = 200 uri = /network-bootstore-config
22732025-03-08T00:42:31.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22742025-03-08T00:42:31.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98543 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63929 req_id = 5ae9b1d4-e793-46c4-8aea-8584eb13390d response_code = 204 uri = /switch-ports
22752025-03-08T00:42:31.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63929 req_id = 0979a70d-9950-4eeb-b247-383f45bd2e17 response_code = 200 uri = /network-bootstore-config
22762025-03-08T00:42:31.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59549
22772025-03-08T00:42:31.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59549 req_id = 893559ab-31ba-414d-9987-2d66ea12f2fc response_code = 200 uri = /vpc-routes
22782025-03-08T00:42:31.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22792025-03-08T00:42:31.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59549 req_id = 831d1131-5c9c-4397-a617-e7b2b941debe response_code = 204 uri = /eip-gateways
22802025-03-08T00:42:31.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59549 req_id = 08f7c833-9069-4e2a-8f5f-980bff718822 response_code = 204 uri = /vpc-routes
22812025-03-08T00:42:31.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34235
22822025-03-08T00:42:31.312ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22832025-03-08T00:42:31.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22842025-03-08T00:42:31.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34235 req_id = 98b1958a-2265-4657-9464-12cd8436f128 response_code = 204 uri = /switch-ports
22852025-03-08T00:42:31.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47015
22862025-03-08T00:42:31.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47015 req_id = dc520e7d-6118-4add-b879-560572fea522 response_code = 200 uri = /v2p
22872025-03-08T00:42:31.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34235 req_id = bad6658b-73d8-466a-ab09-e0195c60184b response_code = 200 uri = /network-bootstore-config
22882025-03-08T00:42:40.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33011
22892025-03-08T00:42:40.734ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33011 req_id = 4d878887-24f4-47d5-86a0-11ff57bc646c response_code = 200 uri = /baseboard
22902025-03-08T00:42:42.660ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 8d42829a-2188-482d-bbe3-604062b339ec response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
22912025-03-08T00:43:00.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46874
22922025-03-08T00:43:00.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46874 req_id = 90e3702c-dfb4-4fc7-9f99-46450f2d779b response_code = 200 uri = /vpc-routes
22932025-03-08T00:43:00.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
22942025-03-08T00:43:00.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46874 req_id = 4c42b6f7-f28e-420f-822e-21f22b48c8be response_code = 204 uri = /eip-gateways
22952025-03-08T00:43:00.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48607
22962025-03-08T00:43:00.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48607 req_id = c1fa12bb-43d0-4632-a50f-ece6899cc060 response_code = 200 uri = /vpc-routes
22972025-03-08T00:43:00.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64653
22982025-03-08T00:43:00.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22992025-03-08T00:43:00.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23002025-03-08T00:43:00.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132776 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64653 req_id = e6c93f90-8899-4e23-ba0d-d4b2080bad5c response_code = 204 uri = /switch-ports
23012025-03-08T00:43:00.747ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23022025-03-08T00:43:00.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48607 req_id = c12554e5-3974-40b4-9522-d3c8e4953554 response_code = 204 uri = /eip-gateways
23032025-03-08T00:43:00.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65232
23042025-03-08T00:43:00.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64653 req_id = 1fc929dc-56b6-4fef-b6e3-bb8cef90aa88 response_code = 200 uri = /network-bootstore-config
23052025-03-08T00:43:00.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63898
23062025-03-08T00:43:00.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 607 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46874 req_id = dbe31f57-f795-4d27-b506-fb8399977e8a response_code = 204 uri = /vpc-routes
23072025-03-08T00:43:00.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65232 req_id = fafe5699-d9dd-4220-b67d-f96185b7f9e8 response_code = 200 uri = /v2p
23082025-03-08T00:43:00.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63898 req_id = d9b5da1d-b4d8-4ebc-a622-43527714835f response_code = 200 uri = /v2p
23092025-03-08T00:43:00.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48607 req_id = e41fbd75-6596-474e-af72-a3ac9c37e7e1 response_code = 204 uri = /vpc-routes
23102025-03-08T00:43:00.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37391
23112025-03-08T00:43:00.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23122025-03-08T00:43:00.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23132025-03-08T00:43:00.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37391 req_id = 5ac34ee1-b222-4b45-959d-798cffd8bab1 response_code = 204 uri = /switch-ports
23142025-03-08T00:43:00.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37391 req_id = 585e842d-c2c1-4931-a196-ec95b416770b response_code = 200 uri = /network-bootstore-config
23152025-03-08T00:43:00.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39718
23162025-03-08T00:43:00.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39718 req_id = 46792dc0-0b63-4895-9523-613cc7b95ac6 response_code = 200 uri = /v2p
23172025-03-08T00:43:00.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44991
23182025-03-08T00:43:00.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44991 req_id = b06cc83c-d05b-4ca9-922a-8ec92a1f7ba4 response_code = 200 uri = /vpc-routes
23192025-03-08T00:43:01.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23202025-03-08T00:43:01.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44991 req_id = a9d37fef-d038-4ada-abb7-106086e8f547 response_code = 204 uri = /eip-gateways
23212025-03-08T00:43:01.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44991 req_id = af4c0efc-c275-4054-957d-9cd513bc5da6 response_code = 204 uri = /vpc-routes
23222025-03-08T00:43:01.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39820
23232025-03-08T00:43:01.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23242025-03-08T00:43:01.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23252025-03-08T00:43:01.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39820 req_id = 5be59086-8dad-4071-83a8-05186d344a2d response_code = 204 uri = /switch-ports
23262025-03-08T00:43:01.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39820 req_id = a814d848-4cec-47ec-b656-bbdd08b75058 response_code = 200 uri = /network-bootstore-config
23272025-03-08T00:43:10.768ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51328
23282025-03-08T00:43:10.768ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51328 req_id = db7f122a-c163-4fed-b2ae-2c74b8375911 response_code = 200 uri = /baseboard
23292025-03-08T00:43:12.660ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7372 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = cba5e669-cca8-4520-b292-9a8e469cd447 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
23302025-03-08T00:43:14.353ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
23312025-03-08T00:43:14.353ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
23322025-03-08T00:43:14.353ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
23332025-03-08T00:43:14.353ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
23342025-03-08T00:43:30.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39806
23352025-03-08T00:43:30.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39806 req_id = ab06d829-40eb-4bc8-8768-6a633dc8ea4d response_code = 200 uri = /vpc-routes
23362025-03-08T00:43:30.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35044
23372025-03-08T00:43:30.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35044 req_id = 02fc1364-1c6c-46ec-bd38-d1364a1e1a0a response_code = 200 uri = /vpc-routes
23382025-03-08T00:43:30.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47670
23392025-03-08T00:43:30.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47670 req_id = e90920a1-f8b6-49fc-9050-32aba7cdf62c response_code = 200 uri = /v2p
23402025-03-08T00:43:30.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23412025-03-08T00:43:30.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35044 req_id = 4da4f42a-3fb5-436f-92e5-baa021466b47 response_code = 204 uri = /eip-gateways
23422025-03-08T00:43:30.791ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23432025-03-08T00:43:30.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39806 req_id = f62ecbd2-f03b-465e-9e71-39101233b871 response_code = 204 uri = /eip-gateways
23442025-03-08T00:43:30.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39806 req_id = 56711c56-8808-4f54-885c-ee3b7da77aa9 response_code = 204 uri = /vpc-routes
23452025-03-08T00:43:30.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63194
23462025-03-08T00:43:30.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63194 req_id = 1509c1d9-d2d6-4224-9126-4f6a422deb40 response_code = 200 uri = /v2p
23472025-03-08T00:43:30.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35044 req_id = 775bbea3-dc14-4f92-b3e5-e73c6eecd075 response_code = 204 uri = /vpc-routes
23482025-03-08T00:43:30.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34826
23492025-03-08T00:43:30.896ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23502025-03-08T00:43:30.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23512025-03-08T00:43:31.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34826 req_id = 5b82c08f-851f-4d5b-85e7-23f90ccbd3c5 response_code = 204 uri = /switch-ports
23522025-03-08T00:43:31.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58947
23532025-03-08T00:43:31.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34826 req_id = bdc1ac30-992a-4300-86f6-e2d5fb9bfef7 response_code = 200 uri = /network-bootstore-config
23542025-03-08T00:43:31.003ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23552025-03-08T00:43:31.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36904
23562025-03-08T00:43:31.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36904 req_id = 189ce09c-f680-48b2-ad06-c60de97afc8f response_code = 200 uri = /vpc-routes
23572025-03-08T00:43:31.046ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23582025-03-08T00:43:31.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23592025-03-08T00:43:31.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36904 req_id = 7c46bc31-2d49-433d-84c3-85a3960db9f5 response_code = 204 uri = /eip-gateways
23602025-03-08T00:43:31.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58947 req_id = 0ddebd00-af88-42e1-8edd-7ec67bbc7f00 response_code = 204 uri = /switch-ports
23612025-03-08T00:43:31.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58947 req_id = 871f8b86-2a3d-43d3-9e15-5e640aaaf6d6 response_code = 200 uri = /network-bootstore-config
23622025-03-08T00:43:31.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54721
23632025-03-08T00:43:31.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54721 req_id = b86ff023-915f-41cc-ae62-975b31c56f40 response_code = 200 uri = /v2p
23642025-03-08T00:43:31.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36904 req_id = 890ba0bc-9759-40fb-9941-25d00ce7d1da response_code = 204 uri = /vpc-routes
23652025-03-08T00:43:31.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34293
23662025-03-08T00:43:31.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23672025-03-08T00:43:31.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23682025-03-08T00:43:31.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34293 req_id = 6b6e5c62-b794-4c9e-a61f-05bc9e7639a2 response_code = 204 uri = /switch-ports
23692025-03-08T00:43:31.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34293 req_id = 323e925d-20a7-4892-895e-57f0ac56d5dd response_code = 200 uri = /network-bootstore-config
23702025-03-08T00:43:40.800ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33646
23712025-03-08T00:43:40.801ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33646 req_id = bbb31745-ae15-457f-84b6-d3acf55536a6 response_code = 200 uri = /baseboard
23722025-03-08T00:43:42.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7053 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 871ce3c5-0f5d-4f85-9ac9-da130201c70e response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
23732025-03-08T00:44:00.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50915
23742025-03-08T00:44:00.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50915 req_id = 30e3c40f-5423-47bc-a914-78eae3818a64 response_code = 200 uri = /vpc-routes
23752025-03-08T00:44:00.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23762025-03-08T00:44:00.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50915 req_id = 3d0c150f-6827-428b-a07a-3d18fcbd1211 response_code = 204 uri = /eip-gateways
23772025-03-08T00:44:00.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53658
23782025-03-08T00:44:00.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53658 req_id = a99c6971-e4fc-40f7-ac91-e02ed3b2d38e response_code = 200 uri = /vpc-routes
23792025-03-08T00:44:00.580ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
23802025-03-08T00:44:00.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53658 req_id = bc8aef9b-0785-4449-97ed-f9413ce5116a response_code = 204 uri = /eip-gateways
23812025-03-08T00:44:00.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49608
23822025-03-08T00:44:00.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49608 req_id = e2beeb5b-9a58-4681-b12a-96a90d7948db response_code = 200 uri = /v2p
23832025-03-08T00:44:00.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50915 req_id = d70b3566-5a4e-4dc6-b61d-4040de1f44ad response_code = 204 uri = /vpc-routes
23842025-03-08T00:44:00.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43112
23852025-03-08T00:44:00.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43112 req_id = 760fc40d-7f3b-4ad3-863c-fe4c116def25 response_code = 200 uri = /v2p
23862025-03-08T00:44:00.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53658 req_id = 8808f017-4c30-47b4-a7ce-2b999ec5bb65 response_code = 204 uri = /vpc-routes
23872025-03-08T00:44:00.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57056
23882025-03-08T00:44:00.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23892025-03-08T00:44:00.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23902025-03-08T00:44:00.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57056 req_id = 11abacdf-841c-429c-94e1-9a58e95742e5 response_code = 204 uri = /switch-ports
23912025-03-08T00:44:00.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58553
23922025-03-08T00:44:00.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57056 req_id = d8081423-8912-4227-bfbf-618b7615c2b4 response_code = 200 uri = /network-bootstore-config
23932025-03-08T00:44:00.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23942025-03-08T00:44:00.812ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23952025-03-08T00:44:00.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58553 req_id = d399d758-ff19-4b5c-acb5-5631284f4ad9 response_code = 204 uri = /switch-ports
23962025-03-08T00:44:00.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58553 req_id = 004e5223-cfe6-495b-b48d-ab73ad5d32d5 response_code = 200 uri = /network-bootstore-config
23972025-03-08T00:44:00.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56054
23982025-03-08T00:44:00.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56054 req_id = 9276d30d-7686-49b7-8c07-87f32d1ab751 response_code = 200 uri = /vpc-routes
23992025-03-08T00:44:00.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24002025-03-08T00:44:00.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56054 req_id = d12fba4f-8789-4a6a-b0fa-499e7694eb98 response_code = 204 uri = /eip-gateways
24012025-03-08T00:44:00.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45925
24022025-03-08T00:44:00.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45925 req_id = 3e7674ab-7540-4958-8605-8308e8a51ebe response_code = 200 uri = /v2p
24032025-03-08T00:44:00.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56054 req_id = a7fe9199-aa67-4cfd-aa16-3eaee3112d7f response_code = 204 uri = /vpc-routes
24042025-03-08T00:44:01.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37601
24052025-03-08T00:44:01.125ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24062025-03-08T00:44:01.165ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24072025-03-08T00:44:01.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37601 req_id = 6d98de46-cd05-43a9-a288-90e6ef3d9cab response_code = 204 uri = /switch-ports
24082025-03-08T00:44:01.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37601 req_id = 12feb5ec-220c-45d6-93fb-a64f82384ce6 response_code = 200 uri = /network-bootstore-config
24092025-03-08T00:44:10.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59933
24102025-03-08T00:44:10.835ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59933 req_id = 92e5ef12-ced2-41a9-b258-cde5379c0b98 response_code = 200 uri = /baseboard
24112025-03-08T00:44:12.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7520 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = f74e6dce-a1de-47a1-9880-f4dc1afe02b5 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
24122025-03-08T00:44:14.352ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
24132025-03-08T00:44:14.354ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
24142025-03-08T00:44:14.354ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
24152025-03-08T00:44:14.354ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
24162025-03-08T00:44:30.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58554
24172025-03-08T00:44:30.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58554 req_id = 2464a6a9-954f-4cac-b219-3629b42c1b1a response_code = 200 uri = /vpc-routes
24182025-03-08T00:44:30.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49147
24192025-03-08T00:44:30.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49147 req_id = 5066e0be-f379-495d-9870-f608644c308a response_code = 200 uri = /vpc-routes
24202025-03-08T00:44:30.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24212025-03-08T00:44:30.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58554 req_id = 8a440b8b-0208-4ddd-8805-1f728c90a2f2 response_code = 204 uri = /eip-gateways
24222025-03-08T00:44:30.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58554 req_id = 2a7e6840-0c39-4e7e-b2f1-2a541a76889b response_code = 204 uri = /vpc-routes
24232025-03-08T00:44:30.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35742
24242025-03-08T00:44:30.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35742 req_id = cb9896f5-383a-4d86-ab04-56478b331293 response_code = 200 uri = /v2p
24252025-03-08T00:44:30.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24262025-03-08T00:44:30.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49147 req_id = 46befe51-ba01-4de0-b7fc-5c7bcd514217 response_code = 204 uri = /eip-gateways
24272025-03-08T00:44:30.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65268
24282025-03-08T00:44:30.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24292025-03-08T00:44:30.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24302025-03-08T00:44:30.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65268 req_id = 402113b0-de9c-4c13-9820-4893ef0381be response_code = 204 uri = /switch-ports
24312025-03-08T00:44:30.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37959
24322025-03-08T00:44:30.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37959 req_id = 57bd3409-9a31-4f07-9686-fb8c61f9f044 response_code = 200 uri = /v2p
24332025-03-08T00:44:30.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65268 req_id = 8ec616c9-9628-4341-ae69-0dce0b28d0ad response_code = 200 uri = /network-bootstore-config
24342025-03-08T00:44:30.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49147 req_id = 6fac9fc7-d99e-4a39-994e-f6fd3c0437be response_code = 204 uri = /vpc-routes
24352025-03-08T00:44:30.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40130
24362025-03-08T00:44:30.908ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24372025-03-08T00:44:30.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24382025-03-08T00:44:30.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40130 req_id = 16513b5f-a37d-4f33-a0f7-abaf3461836d response_code = 204 uri = /switch-ports
24392025-03-08T00:44:30.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40130 req_id = 36a9cab6-ce38-4233-a655-f84fe248d686 response_code = 200 uri = /network-bootstore-config
24402025-03-08T00:44:31.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65317
24412025-03-08T00:44:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65317 req_id = bc31e8fe-aaa3-4fe0-9482-dd65cfa7e9f7 response_code = 200 uri = /vpc-routes
24422025-03-08T00:44:31.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24432025-03-08T00:44:31.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65317 req_id = 9449b886-39de-4bb6-b1fd-2fdad3b71219 response_code = 204 uri = /eip-gateways
24442025-03-08T00:44:31.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65317 req_id = 58197ef0-e568-492b-aaf8-299539691ede response_code = 204 uri = /vpc-routes
24452025-03-08T00:44:31.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63332
24462025-03-08T00:44:31.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63332 req_id = 2ecf29da-cf28-4476-8d6e-56300bd202f0 response_code = 200 uri = /v2p
24472025-03-08T00:44:31.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60487
24482025-03-08T00:44:31.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24492025-03-08T00:44:31.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24502025-03-08T00:44:31.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60487 req_id = b29c0623-e4bb-48b4-8d45-a244df7a95c6 response_code = 204 uri = /switch-ports
24512025-03-08T00:44:31.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60487 req_id = c46300dd-707c-468f-8a24-b1b3f5f21f46 response_code = 200 uri = /network-bootstore-config
24522025-03-08T00:44:40.867ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61755
24532025-03-08T00:44:40.867ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61755 req_id = 621c46cc-b619-453a-8904-63b1e48d6d42 response_code = 200 uri = /baseboard
24542025-03-08T00:44:42.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6580 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = c43cc168-1fff-4910-a172-703085fb5392 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
24552025-03-08T00:45:00.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59606
24562025-03-08T00:45:00.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59606 req_id = 26e3dc69-3b35-49bc-bec5-8c4b4bda65a9 response_code = 200 uri = /vpc-routes
24572025-03-08T00:45:00.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46672
24582025-03-08T00:45:00.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46672 req_id = 795c9892-b966-4755-9076-b86e443b9be0 response_code = 200 uri = /v2p
24592025-03-08T00:45:00.665ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24602025-03-08T00:45:00.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59606 req_id = d9e6f42e-26f3-416c-9ceb-8723ef322cca response_code = 204 uri = /eip-gateways
24612025-03-08T00:45:00.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60569
24622025-03-08T00:45:00.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60569 req_id = fafbd5f0-33a0-40bb-9f51-09c5b120d207 response_code = 200 uri = /vpc-routes
24632025-03-08T00:45:00.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59606 req_id = 39b3fc25-615d-4a93-97cd-9dcff763d866 response_code = 204 uri = /vpc-routes
24642025-03-08T00:45:00.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24652025-03-08T00:45:00.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60569 req_id = 43786b8c-a621-413c-aac8-f4346db8a541 response_code = 204 uri = /eip-gateways
24662025-03-08T00:45:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60569 req_id = 706e1311-1d81-4c9d-99ca-0fbf55d70025 response_code = 204 uri = /vpc-routes
24672025-03-08T00:45:00.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37520
24682025-03-08T00:45:00.751ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24692025-03-08T00:45:00.818ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24702025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37520 req_id = 7c5f6e6b-e300-4024-9121-a3d69bddb906 response_code = 204 uri = /switch-ports
24712025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59467
24722025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62201
24732025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39892
24742025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56503
24752025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59467 req_id = dfa58910-571d-4378-a0c7-cba84abc6cc8 response_code = 200 uri = /vpc-routes
24762025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 448 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37520 req_id = d5efec7e-b139-4553-aa20-1d781e53422e response_code = 200 uri = /network-bootstore-config
24772025-03-08T00:45:00.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62201 req_id = ecc987b2-8d6d-406e-aeea-377e3aa322b1 response_code = 200 uri = /v2p
24782025-03-08T00:45:00.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56503 req_id = 0d0c9831-14de-49ad-817c-40a3e6c62df8 response_code = 200 uri = /v2p
24792025-03-08T00:45:00.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24802025-03-08T00:45:00.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62235
24812025-03-08T00:45:00.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
24822025-03-08T00:45:00.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59467 req_id = 59e809e3-02e3-4559-ada3-fa2286c4e164 response_code = 204 uri = /eip-gateways
24832025-03-08T00:45:00.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59467 req_id = a230bb6b-57b6-42d5-9059-34255573853b response_code = 204 uri = /vpc-routes
24842025-03-08T00:45:01.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24852025-03-08T00:45:01.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151714 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39892 req_id = d30800d8-b7bd-4f0e-8ffe-2e63d1196d2d response_code = 204 uri = /switch-ports
24862025-03-08T00:45:01.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24872025-03-08T00:45:01.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39892 req_id = ac538cf1-e525-48a2-b5de-411857dda57b response_code = 200 uri = /network-bootstore-config
24882025-03-08T00:45:01.167ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24892025-03-08T00:45:01.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62235 req_id = f1c66b8c-c75c-47a0-b388-0723dfc3301e response_code = 204 uri = /switch-ports
24902025-03-08T00:45:01.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62235 req_id = a0d0726b-81ff-4e7f-aeba-a6dcb1f8ebae response_code = 200 uri = /network-bootstore-config
24912025-03-08T00:45:10.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54748
24922025-03-08T00:45:10.899ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54748 req_id = d81eec72-69c3-4f10-8d79-8ab56e2d4aba response_code = 200 uri = /baseboard
24932025-03-08T00:45:12.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7134 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = aa18eab6-6208-47fd-b96b-7a61dbb2e953 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
24942025-03-08T00:45:14.352ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
24952025-03-08T00:45:14.352ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
24962025-03-08T00:45:14.352ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
24972025-03-08T00:45:14.353ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
24982025-03-08T00:45:30.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56198
24992025-03-08T00:45:30.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56198 req_id = ef50d83b-2890-48ec-b15a-0b9ea827493e response_code = 200 uri = /vpc-routes
25002025-03-08T00:45:30.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50904
25012025-03-08T00:45:30.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25022025-03-08T00:45:30.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50904 req_id = 31bf3218-bcc7-4bbe-bcb2-733bd6a85ff0 response_code = 200 uri = /artifacts
25032025-03-08T00:45:30.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
25042025-03-08T00:45:30.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56198 req_id = d8b78f9f-7252-4995-9631-f18bba0c23ae response_code = 204 uri = /eip-gateways
25052025-03-08T00:45:30.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56198 req_id = ba036b0e-ea5e-4c8b-82b1-4fa981879c12 response_code = 204 uri = /vpc-routes
25062025-03-08T00:45:30.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61031
25072025-03-08T00:45:30.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61031 req_id = 2c4cbb1e-4e00-4a75-a740-77858495bb61 response_code = 200 uri = /vpc-routes
25082025-03-08T00:45:30.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42703
25092025-03-08T00:45:30.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42703 req_id = 0074eda3-3d8c-40c8-8332-19ec84f13aa2 response_code = 200 uri = /v2p
25102025-03-08T00:45:30.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41351
25112025-03-08T00:45:30.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25122025-03-08T00:45:30.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41351 req_id = c8456d8c-8ced-41e0-aeb3-0f770d5c0e70 response_code = 200 uri = /artifacts
25132025-03-08T00:45:30.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
25142025-03-08T00:45:30.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61031 req_id = 22b34493-5e2b-40e7-8b46-c19952d20100 response_code = 204 uri = /eip-gateways
25152025-03-08T00:45:30.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39821
25162025-03-08T00:45:30.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39821 req_id = 51c4caaf-5367-4c73-9da9-af8edefeb914 response_code = 200 uri = /v2p
25172025-03-08T00:45:30.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61031 req_id = 9c208cdb-8bea-474f-9820-097bb08cd28c response_code = 204 uri = /vpc-routes
25182025-03-08T00:45:30.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42823
25192025-03-08T00:45:30.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25202025-03-08T00:45:31.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25212025-03-08T00:45:31.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118232 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42823 req_id = 8d90c9cd-9903-4c3c-ad5f-7b7bf47a61c3 response_code = 204 uri = /switch-ports
25222025-03-08T00:45:31.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34909
25232025-03-08T00:45:31.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50620
25242025-03-08T00:45:31.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25252025-03-08T00:45:31.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50620 req_id = 1c0a97eb-ed50-4419-b703-a624c4eb84b9 response_code = 200 uri = /vpc-routes
25262025-03-08T00:45:31.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42823 req_id = 3ed5c4aa-226d-4dea-b6fa-afc49a9b9aa1 response_code = 200 uri = /network-bootstore-config
25272025-03-08T00:45:31.125ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25282025-03-08T00:45:31.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62312
25292025-03-08T00:45:31.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25302025-03-08T00:45:31.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62312 req_id = 7b1102ca-e287-4a87-86f3-6e15e9e7c5f8 response_code = 200 uri = /artifacts
25312025-03-08T00:45:31.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34909 req_id = 3bf925f1-c522-4521-910c-d227522f01b1 response_code = 204 uri = /switch-ports
25322025-03-08T00:45:31.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34909 req_id = 1ccf3f76-e95a-4800-a9ef-32281e0616c8 response_code = 200 uri = /network-bootstore-config
25332025-03-08T00:45:31.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
25342025-03-08T00:45:31.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50620 req_id = ec7caf72-299b-4e4a-a490-f0fb47987e55 response_code = 204 uri = /eip-gateways
25352025-03-08T00:45:31.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50620 req_id = 809ffa28-e6ed-4517-a16c-25be9d961931 response_code = 204 uri = /vpc-routes
25362025-03-08T00:45:31.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46046
25372025-03-08T00:45:31.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25382025-03-08T00:45:31.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25392025-03-08T00:45:31.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46046 req_id = 7d807151-9e65-4e5e-a0e3-43d9476a3fdd response_code = 204 uri = /switch-ports
25402025-03-08T00:45:31.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58489
25412025-03-08T00:45:31.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46690
25422025-03-08T00:45:31.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58489 req_id = d13e5e3c-e763-4475-9191-20e1a5df7b2e response_code = 200 uri = /v2p
25432025-03-08T00:45:31.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46046 req_id = 075c6f3c-d195-4b8b-8412-473d624f7923 response_code = 200 uri = /network-bootstore-config
25442025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25452025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25462025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25482025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25492025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25502025-03-08T00:45:31.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25512025-03-08T00:45:31.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 508 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46690 req_id = 11132e4a-ab5b-47fa-a1f3-0dd42cda60de response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25522025-03-08T00:45:31.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35352
25532025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25542025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25552025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25562025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25572025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25582025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25592025-03-08T00:45:31.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25602025-03-08T00:45:31.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35352 req_id = d019e141-99cf-439e-be3a-99e4c42088f7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25612025-03-08T00:45:31.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46261
25622025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25632025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25642025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25652025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25662025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
25672025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25682025-03-08T00:45:31.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25692025-03-08T00:45:31.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46261 req_id = 12400e50-d066-4519-be5b-6fc5e065bba6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25702025-03-08T00:45:40.931ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43598
25712025-03-08T00:45:40.931ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43598 req_id = 351cabb7-8879-49cf-be42-0d0940538fea response_code = 200 uri = /baseboard
25722025-03-08T00:45:42.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7336 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 60b52a0d-c704-498e-b0f0-cb4294380e86 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
25732025-03-08T00:46:00.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51125
25742025-03-08T00:46:00.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51125 req_id = 5b43b3d3-1990-4095-b626-56496bac67d2 response_code = 200 uri = /vpc-routes
25752025-03-08T00:46:00.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
25762025-03-08T00:46:00.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51125 req_id = 35ce819d-8499-4153-88ab-03b3d6b7dff9 response_code = 204 uri = /eip-gateways
25772025-03-08T00:46:00.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34878
25782025-03-08T00:46:00.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34878 req_id = 186f2333-39a0-4d9b-b777-ac11f044b490 response_code = 200 uri = /vpc-routes
25792025-03-08T00:46:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51125 req_id = 1c570a8c-8804-4cca-ab5c-25a5142859b6 response_code = 204 uri = /vpc-routes
25802025-03-08T00:46:00.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39368
25812025-03-08T00:46:00.558ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25822025-03-08T00:46:00.602ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25832025-03-08T00:46:00.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39368 req_id = 8880bfa6-415d-4ba5-8c6e-7f3346ee0450 response_code = 204 uri = /switch-ports
25842025-03-08T00:46:00.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57069
25852025-03-08T00:46:00.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39368 req_id = 03a8d6b3-d71e-42bd-9903-1de90c5b5319 response_code = 200 uri = /network-bootstore-config
25862025-03-08T00:46:00.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
25872025-03-08T00:46:00.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34878 req_id = d47cd4a4-ecc5-4277-91ed-27c12137785d response_code = 204 uri = /eip-gateways
25882025-03-08T00:46:00.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57069 req_id = 3ddf72c0-7f57-4827-a9fc-51e1ad64e666 response_code = 200 uri = /v2p
25892025-03-08T00:46:00.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38595
25902025-03-08T00:46:00.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25912025-03-08T00:46:00.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25922025-03-08T00:46:00.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38595 req_id = 1cfb9af6-d53f-4fa3-8e5e-dea044baaad1 response_code = 204 uri = /switch-ports
25932025-03-08T00:46:00.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58208
25942025-03-08T00:46:00.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34878 req_id = a8e28a0b-d23b-41bb-bd6a-87184558bb2b response_code = 204 uri = /vpc-routes
25952025-03-08T00:46:00.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58208 req_id = 2d3b435c-1a71-4f30-b344-e777e5b1ab82 response_code = 200 uri = /v2p
25962025-03-08T00:46:00.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38595 req_id = 62209d86-dbc2-43a6-bd6d-3297218ccabc response_code = 200 uri = /network-bootstore-config
25972025-03-08T00:46:00.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41279
25982025-03-08T00:46:00.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41279 req_id = 0d931bd2-43ea-4fb5-97bb-558fee6168a4 response_code = 200 uri = /vpc-routes
25992025-03-08T00:46:00.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26002025-03-08T00:46:00.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41279 req_id = c9815849-daca-4568-a730-e7feadd0446b response_code = 204 uri = /eip-gateways
26012025-03-08T00:46:01.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62135
26022025-03-08T00:46:01.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62135 req_id = 61da591b-feea-474d-92ea-e831a386e6c9 response_code = 200 uri = /v2p
26032025-03-08T00:46:01.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41279 req_id = 27e4fb42-e704-43c7-96f7-6fa79f8eecfe response_code = 204 uri = /vpc-routes
26042025-03-08T00:46:01.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40863
26052025-03-08T00:46:01.074ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26062025-03-08T00:46:01.108ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26072025-03-08T00:46:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40863 req_id = 7dcfd1c9-8956-4747-8f13-394e497620af response_code = 204 uri = /switch-ports
26082025-03-08T00:46:01.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40863 req_id = 6c4338af-2c93-4ee7-99d4-de3fe2873102 response_code = 200 uri = /network-bootstore-config
26092025-03-08T00:46:10.965ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63431
26102025-03-08T00:46:10.965ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63431 req_id = 219120ed-64f7-4192-bb9c-8c0213878a93 response_code = 200 uri = /baseboard
26112025-03-08T00:46:12.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8067 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = e22f1cc3-b074-4d12-a064-468ac86834d2 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
26122025-03-08T00:46:14.351ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
26132025-03-08T00:46:14.352ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
26142025-03-08T00:46:14.352ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
26152025-03-08T00:46:14.352ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
26162025-03-08T00:46:15.653ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:212
26172025-03-08T00:46:15.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26182025-03-08T00:46:15.681ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:201 next_cleanup = Instant { tv_sec: 1858, tv_nsec: 703552736 } time_to_next_cleanup = 599.99999701s
26192025-03-08T00:46:30.304ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
26202025-03-08T00:46:30.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53477
26212025-03-08T00:46:30.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53477 req_id = 0c64d485-c61b-4af4-9fa3-a60143fd34a4 response_code = 200 uri = /vpc-routes
26222025-03-08T00:46:30.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51362
26232025-03-08T00:46:30.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51362 req_id = b156ce75-95a5-4fdb-84c4-400347c54b8a response_code = 200 uri = /vpc-routes
26242025-03-08T00:46:30.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52615
26252025-03-08T00:46:30.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52615 req_id = 7702109f-ac59-4b23-8e8e-fb10c81afdf5 response_code = 200 uri = /v2p
26262025-03-08T00:46:30.799ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26272025-03-08T00:46:30.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53477 req_id = 5624dd0f-4858-43ce-889c-74bad5af8e9b response_code = 204 uri = /eip-gateways
26282025-03-08T00:46:30.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26292025-03-08T00:46:30.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51362 req_id = 686eaccb-1155-4609-8e35-9e56b74f4bb6 response_code = 204 uri = /eip-gateways
26302025-03-08T00:46:30.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53477 req_id = 743370dc-cf4b-49a9-ab5e-d56abca2e80e response_code = 204 uri = /vpc-routes
26312025-03-08T00:46:30.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51362 req_id = 43e1cd96-a572-4b16-8418-a96de7f3e3b5 response_code = 204 uri = /vpc-routes
26322025-03-08T00:46:30.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55618
26332025-03-08T00:46:30.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55618 req_id = 0042dbb6-223f-405b-87c5-1960e3168f37 response_code = 200 uri = /v2p
26342025-03-08T00:46:30.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61681
26352025-03-08T00:46:30.858ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26362025-03-08T00:46:30.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26372025-03-08T00:46:30.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61681 req_id = 1ce9aef5-6e19-4b2a-8a37-cb4f6db3b97c response_code = 204 uri = /switch-ports
26382025-03-08T00:46:30.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55525
26392025-03-08T00:46:30.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26402025-03-08T00:46:30.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3787 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61681 req_id = a03d2eff-ff55-4814-ba6b-5f999fe6e441 response_code = 200 uri = /network-bootstore-config
26412025-03-08T00:46:31.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26422025-03-08T00:46:31.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49642
26432025-03-08T00:46:31.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49642 req_id = 1df842bb-8eeb-47d1-95b9-7cc1b0db71b6 response_code = 200 uri = /vpc-routes
26442025-03-08T00:46:31.054ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26452025-03-08T00:46:31.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49642 req_id = 14a25165-b188-4fb4-b4ca-6c030a544676 response_code = 204 uri = /eip-gateways
26462025-03-08T00:46:31.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55525 req_id = 8265ab41-c13e-4ac4-ae7b-ec23bc5ebe7f response_code = 204 uri = /switch-ports
26472025-03-08T00:46:31.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49642 req_id = 73727111-8198-49fb-b527-95102ec3471e response_code = 204 uri = /vpc-routes
26482025-03-08T00:46:31.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55525 req_id = 24a7356f-a889-48fc-ae20-44ce55e56329 response_code = 200 uri = /network-bootstore-config
26492025-03-08T00:46:31.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63292
26502025-03-08T00:46:31.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63292 req_id = a303750f-e381-457f-9665-61649877d0d0 response_code = 200 uri = /v2p
26512025-03-08T00:46:31.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39181
26522025-03-08T00:46:31.130ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26532025-03-08T00:46:31.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26542025-03-08T00:46:31.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39181 req_id = ca7ad3e1-d92c-458d-818a-ac9dff8298b2 response_code = 204 uri = /switch-ports
26552025-03-08T00:46:31.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39181 req_id = 3075e592-f103-4426-a83f-b93babe9f503 response_code = 200 uri = /network-bootstore-config
26562025-03-08T00:46:40.999ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48822
26572025-03-08T00:46:40.999ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48822 req_id = bbe032b6-c58e-4863-aeff-4dd1b7e0d6e4 response_code = 200 uri = /baseboard
26582025-03-08T00:46:42.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7788 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = d04cd64f-6ea6-4e02-8877-b843fee08881 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
26592025-03-08T00:47:00.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36195
26602025-03-08T00:47:00.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36195 req_id = 52d42040-9974-4f50-a8e2-9ccc47f80d63 response_code = 200 uri = /vpc-routes
26612025-03-08T00:47:00.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47190
26622025-03-08T00:47:00.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47190 req_id = f1e9b90a-489f-4a30-977b-25e032aca4e1 response_code = 200 uri = /v2p
26632025-03-08T00:47:00.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57344
26642025-03-08T00:47:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57344 req_id = 4103dc59-eb03-4511-bfa7-e238e9d19acd response_code = 200 uri = /vpc-routes
26652025-03-08T00:47:00.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26662025-03-08T00:47:00.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36195 req_id = fc0a8cb7-aa27-49a5-b1cc-1a9612817fa1 response_code = 204 uri = /eip-gateways
26672025-03-08T00:47:00.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36195 req_id = 9fbc82de-f6a5-4ad9-8433-ab4639ee470e response_code = 204 uri = /vpc-routes
26682025-03-08T00:47:00.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26692025-03-08T00:47:00.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57344 req_id = ca5fd605-5ca3-4310-ba92-97209dfad0b5 response_code = 204 uri = /eip-gateways
26702025-03-08T00:47:00.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57344 req_id = 0e5709fa-b57d-47a9-8310-d43a154d1832 response_code = 204 uri = /vpc-routes
26712025-03-08T00:47:00.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46239
26722025-03-08T00:47:00.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26732025-03-08T00:47:00.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26742025-03-08T00:47:00.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46239 req_id = 910563dc-ce14-4ba5-a438-4fe597323471 response_code = 204 uri = /switch-ports
26752025-03-08T00:47:00.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51700
26762025-03-08T00:47:00.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57632
26772025-03-08T00:47:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51700 req_id = f70d1a04-c409-4525-83e1-ee185902ea4e response_code = 200 uri = /v2p
26782025-03-08T00:47:00.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26792025-03-08T00:47:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46239 req_id = 8985b743-8e58-4bce-bbb7-c51fccb5b3ee response_code = 200 uri = /network-bootstore-config
26802025-03-08T00:47:00.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26812025-03-08T00:47:00.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59379
26822025-03-08T00:47:00.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59379 req_id = 753a9285-c63e-400f-8607-a74896596b5f response_code = 200 uri = /vpc-routes
26832025-03-08T00:47:00.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57632 req_id = da955f04-28b4-4a4f-a663-c6f8291a569a response_code = 204 uri = /switch-ports
26842025-03-08T00:47:00.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57632 req_id = c8e2976b-15b6-4fef-8199-2e1609928431 response_code = 200 uri = /network-bootstore-config
26852025-03-08T00:47:00.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
26862025-03-08T00:47:00.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59379 req_id = 1135b356-1d11-4124-b583-96fc248f63dc response_code = 204 uri = /eip-gateways
26872025-03-08T00:47:00.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59379 req_id = 7b45a60d-d74b-47df-b14d-156733bd5405 response_code = 204 uri = /vpc-routes
26882025-03-08T00:47:00.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63766
26892025-03-08T00:47:00.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26902025-03-08T00:47:00.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26912025-03-08T00:47:01.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63766 req_id = ee35e0fc-39cb-46e0-99ce-12967a6c6d68 response_code = 204 uri = /switch-ports
26922025-03-08T00:47:01.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39691
26932025-03-08T00:47:01.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63766 req_id = 891c1440-b72a-4eea-8cf8-d4bf0db44472 response_code = 200 uri = /network-bootstore-config
26942025-03-08T00:47:01.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39691 req_id = 4b084588-0e6d-4f84-a812-5c5d130981f5 response_code = 200 uri = /v2p
26952025-03-08T00:47:11.032ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64756
26962025-03-08T00:47:11.032ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64756 req_id = 78bce0fc-b6fa-4dca-86b9-6c6a0a793b6b response_code = 200 uri = /baseboard
26972025-03-08T00:47:12.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7689 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = e24f215f-4a56-4af7-80d1-9b88b5568ef9 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
26982025-03-08T00:47:14.352ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
26992025-03-08T00:47:14.352ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
27002025-03-08T00:47:14.352ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
27012025-03-08T00:47:14.352ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
27022025-03-08T00:47:30.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40215
27032025-03-08T00:47:30.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40215 req_id = 3d00f689-8204-4d62-927c-ff2a65d67438 response_code = 200 uri = /vpc-routes
27042025-03-08T00:47:30.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27052025-03-08T00:47:30.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40215 req_id = 0052963e-cb05-4232-96d5-387c52ec5337 response_code = 204 uri = /eip-gateways
27062025-03-08T00:47:30.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57824
27072025-03-08T00:47:30.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57824 req_id = d255a6a0-8dc0-4c36-ae37-5d8f9826e51c response_code = 200 uri = /vpc-routes
27082025-03-08T00:47:30.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63645
27092025-03-08T00:47:30.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63645 req_id = 82ecdf06-36bd-41b1-849b-18ab41a2ad53 response_code = 200 uri = /v2p
27102025-03-08T00:47:30.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40215 req_id = db2c9cab-6b0f-4b92-a075-9e891a494d80 response_code = 204 uri = /vpc-routes
27112025-03-08T00:47:30.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27122025-03-08T00:47:30.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57824 req_id = f94f5c59-a4ba-43fb-b1cd-1823c6a2cff7 response_code = 204 uri = /eip-gateways
27132025-03-08T00:47:30.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57824 req_id = 2e56f032-046c-429a-ae96-3bc0449917a9 response_code = 204 uri = /vpc-routes
27142025-03-08T00:47:30.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34519
27152025-03-08T00:47:30.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27162025-03-08T00:47:30.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27172025-03-08T00:47:31.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34519 req_id = b5c5d34a-deca-4d70-9a37-8187ce0a75e3 response_code = 204 uri = /switch-ports
27182025-03-08T00:47:31.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34274
27192025-03-08T00:47:31.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61733
27202025-03-08T00:47:31.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34519 req_id = b15b0902-2dd8-4c8b-b638-e24e25c4b255 response_code = 200 uri = /network-bootstore-config
27212025-03-08T00:47:31.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56811
27222025-03-08T00:47:31.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27232025-03-08T00:47:31.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61733 req_id = 6b44894d-cbd2-46b3-8b03-5289f69b60db response_code = 200 uri = /v2p
27242025-03-08T00:47:31.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56811 req_id = 1475ab53-fd3d-4966-a85e-e081920adc15 response_code = 200 uri = /vpc-routes
27252025-03-08T00:47:31.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55703
27262025-03-08T00:47:31.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55703 req_id = db6f842f-41fa-4f51-93d7-dc0eb9898913 response_code = 200 uri = /v2p
27272025-03-08T00:47:31.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27282025-03-08T00:47:31.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56811 req_id = c5f81bb7-862d-4208-a75e-1f411e6b4c5d response_code = 204 uri = /eip-gateways
27292025-03-08T00:47:31.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56811 req_id = 989d7e55-c03f-4a46-97e4-c3801f9a0525 response_code = 204 uri = /vpc-routes
27302025-03-08T00:47:31.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27312025-03-08T00:47:31.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93952 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34274 req_id = cc0fe609-0b71-44fc-8d5b-518a5c544231 response_code = 204 uri = /switch-ports
27322025-03-08T00:47:31.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34274 req_id = 4899cf0a-c218-4fc5-b16d-c481916879ea response_code = 200 uri = /network-bootstore-config
27332025-03-08T00:47:31.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46544
27342025-03-08T00:47:31.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27352025-03-08T00:47:31.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27362025-03-08T00:47:31.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46544 req_id = 3ca78996-db44-4398-a822-f7239ed63c34 response_code = 204 uri = /switch-ports
27372025-03-08T00:47:31.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46544 req_id = b61f1cba-9228-474b-b855-1d85d7f6babd response_code = 200 uri = /network-bootstore-config
27382025-03-08T00:47:41.064ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33314
27392025-03-08T00:47:41.064ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33314 req_id = 76c60232-35e6-4c3f-a66e-19efebf2e315 response_code = 200 uri = /baseboard
27402025-03-08T00:47:42.659ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7816 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = cde9f1bf-2407-4cef-9abc-1a00adeb11f6 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
27412025-03-08T00:48:00.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52773
27422025-03-08T00:48:00.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52773 req_id = 7ae7ab35-6089-40f8-a3c3-5bceec90b12d response_code = 200 uri = /vpc-routes
27432025-03-08T00:48:00.543ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27442025-03-08T00:48:00.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52773 req_id = 959d8bf1-0472-4bb6-9b88-6e8ff40c713f response_code = 204 uri = /eip-gateways
27452025-03-08T00:48:00.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50899
27462025-03-08T00:48:00.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50899 req_id = 9a5123a6-0e40-4353-8327-2d22cd660c0c response_code = 200 uri = /vpc-routes
27472025-03-08T00:48:00.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52773 req_id = dace42da-09ff-4419-8d23-4de5f56771a2 response_code = 204 uri = /vpc-routes
27482025-03-08T00:48:00.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27492025-03-08T00:48:00.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50899 req_id = 096eb639-6d22-4495-b498-f2755907f0a9 response_code = 204 uri = /eip-gateways
27502025-03-08T00:48:00.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50899 req_id = b35bda30-ff17-44e5-836a-57fd2d6c0744 response_code = 204 uri = /vpc-routes
27512025-03-08T00:48:00.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38042
27522025-03-08T00:48:00.611ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27532025-03-08T00:48:00.654ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27542025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38042 req_id = 8fbd92d2-5358-4dbf-b41e-c51fdfc9ef1d response_code = 204 uri = /switch-ports
27552025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45343
27562025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35735
27572025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52913
27582025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45343 req_id = 036a872a-88b6-438f-bb60-b43e88073028 response_code = 200 uri = /v2p
27592025-03-08T00:48:00.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38042 req_id = 38a4ca02-7b36-4756-8cba-f351a10e9360 response_code = 200 uri = /network-bootstore-config
27602025-03-08T00:48:00.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27612025-03-08T00:48:00.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35735 req_id = c907bf48-fcef-4fa7-9383-92415b85f065 response_code = 200 uri = /v2p
27622025-03-08T00:48:00.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58968
27632025-03-08T00:48:00.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58968 req_id = eadc6fb5-e989-4602-83a0-9812564623bc response_code = 200 uri = /vpc-routes
27642025-03-08T00:48:00.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27652025-03-08T00:48:00.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27662025-03-08T00:48:00.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58968 req_id = c671aad1-df5b-40ae-9e92-17f4bfb268d1 response_code = 204 uri = /eip-gateways
27672025-03-08T00:48:00.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 978 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58968 req_id = 64004288-2392-4ada-b2a5-5f7929ad6387 response_code = 204 uri = /vpc-routes
27682025-03-08T00:48:00.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52913 req_id = a9e213b3-52a8-43b1-9d66-b45cf30ec02e response_code = 204 uri = /switch-ports
27692025-03-08T00:48:00.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52913 req_id = d515ef63-6d94-4f76-9110-c0134ed52118 response_code = 200 uri = /network-bootstore-config
27702025-03-08T00:48:00.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36101
27712025-03-08T00:48:00.908ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27722025-03-08T00:48:00.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27732025-03-08T00:48:01.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36101 req_id = 5c5697f9-9177-4100-844e-f7d911c908d5 response_code = 204 uri = /switch-ports
27742025-03-08T00:48:01.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45543
27752025-03-08T00:48:01.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45543 req_id = 16b077c1-b8c8-489c-bc80-29857bac6cbf response_code = 200 uri = /v2p
27762025-03-08T00:48:01.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36101 req_id = 0841f813-3088-48d2-b686-817c8bd140ff response_code = 200 uri = /network-bootstore-config
27772025-03-08T00:48:11.097ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41727
27782025-03-08T00:48:11.097ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41727 req_id = 0ff98101-c503-4eb7-a3cb-3da9c7c52426 response_code = 200 uri = /baseboard
27792025-03-08T00:48:12.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6645 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 5052e093-3fe1-45ae-86c6-82a63567fd0d response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
27802025-03-08T00:48:14.351ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
27812025-03-08T00:48:14.351ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
27822025-03-08T00:48:14.351ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
27832025-03-08T00:48:14.351ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
27842025-03-08T00:48:30.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33853
27852025-03-08T00:48:30.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33853 req_id = e92caf60-14b3-4abe-a9ea-a3c0ccd62a1d response_code = 200 uri = /vpc-routes
27862025-03-08T00:48:30.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49901
27872025-03-08T00:48:30.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49901 req_id = 35edf903-151a-4b19-94bc-866d19437874 response_code = 200 uri = /vpc-routes
27882025-03-08T00:48:30.566ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27892025-03-08T00:48:30.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33853 req_id = a9d669aa-d66a-43d3-a805-dcddd40abff8 response_code = 204 uri = /eip-gateways
27902025-03-08T00:48:30.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33853 req_id = 86c02ed5-5eb0-42da-acaa-204c7c8f39f9 response_code = 204 uri = /vpc-routes
27912025-03-08T00:48:30.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
27922025-03-08T00:48:30.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49901 req_id = 8efb7d01-a9ab-48f1-8b08-0da665495d84 response_code = 204 uri = /eip-gateways
27932025-03-08T00:48:30.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49901 req_id = 2540e4e3-827d-4d50-9621-66b9f5014518 response_code = 204 uri = /vpc-routes
27942025-03-08T00:48:30.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38025
27952025-03-08T00:48:30.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38025 req_id = e64dfe89-8a3c-43ea-a4f5-1e3b0b3b0d41 response_code = 200 uri = /v2p
27962025-03-08T00:48:30.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39455
27972025-03-08T00:48:30.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27982025-03-08T00:48:30.818ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27992025-03-08T00:48:30.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39455 req_id = da65ba8e-d14a-42e7-be3c-89789b2014b3 response_code = 204 uri = /switch-ports
28002025-03-08T00:48:30.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39455 req_id = eaefec57-3342-440e-88b4-c7c786262de1 response_code = 200 uri = /network-bootstore-config
28012025-03-08T00:48:30.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60412
28022025-03-08T00:48:30.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60412 req_id = 00cfd780-a004-425f-99e9-f3e025df3a00 response_code = 200 uri = /v2p
28032025-03-08T00:48:30.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56450
28042025-03-08T00:48:30.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28052025-03-08T00:48:30.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28062025-03-08T00:48:31.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56450 req_id = 0f4d17de-6abe-4e37-952e-5a57449d6324 response_code = 204 uri = /switch-ports
28072025-03-08T00:48:31.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58712
28082025-03-08T00:48:31.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62970
28092025-03-08T00:48:31.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62970 req_id = 4276f516-c059-4711-b216-04c1c81a0d8f response_code = 200 uri = /vpc-routes
28102025-03-08T00:48:31.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56450 req_id = f447d329-282f-49bd-af26-974b787f86ee response_code = 200 uri = /network-bootstore-config
28112025-03-08T00:48:31.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58712 req_id = 211224e5-68e1-4694-bf05-e915b869974c response_code = 200 uri = /v2p
28122025-03-08T00:48:31.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28132025-03-08T00:48:31.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62970 req_id = 6f684075-7060-4f3c-b4d7-87bef696eab2 response_code = 204 uri = /eip-gateways
28142025-03-08T00:48:31.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62970 req_id = 203e8592-c202-4ab3-b486-93129a898a56 response_code = 204 uri = /vpc-routes
28152025-03-08T00:48:31.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64883
28162025-03-08T00:48:31.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28172025-03-08T00:48:31.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28182025-03-08T00:48:31.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64883 req_id = 6a83c8f6-be93-4582-bdfe-edc66fdb9ece response_code = 204 uri = /switch-ports
28192025-03-08T00:48:31.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64883 req_id = ca726ee3-acfe-4d01-898c-e28be4270173 response_code = 200 uri = /network-bootstore-config
28202025-03-08T00:48:41.131ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33381
28212025-03-08T00:48:41.131ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33381 req_id = 780b4ff9-e6f5-4f8c-993a-7281fd4a62c5 response_code = 200 uri = /baseboard
28222025-03-08T00:48:42.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7842 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 6c74d185-c578-4412-8a0f-d98202ca9f63 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
28232025-03-08T00:49:00.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52221
28242025-03-08T00:49:00.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52221 req_id = efc55c90-982a-4269-985e-785ebdb0c207 response_code = 200 uri = /vpc-routes
28252025-03-08T00:49:00.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28262025-03-08T00:49:00.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52221 req_id = 20a5c231-f1b2-4061-bd18-f4cfce7cae5f response_code = 204 uri = /eip-gateways
28272025-03-08T00:49:00.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52221 req_id = 59b1130e-d1eb-4474-9066-b250b1d63a41 response_code = 204 uri = /vpc-routes
28282025-03-08T00:49:00.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56532
28292025-03-08T00:49:00.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56532 req_id = 3019ac51-0b12-472b-ba39-d1a2cd82f3f9 response_code = 200 uri = /vpc-routes
28302025-03-08T00:49:00.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52504
28312025-03-08T00:49:00.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28322025-03-08T00:49:00.648ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28332025-03-08T00:49:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134664 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52504 req_id = 4fe60d58-d46b-48b1-b78f-de7b7ce68f2b response_code = 204 uri = /switch-ports
28342025-03-08T00:49:00.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50265
28352025-03-08T00:49:00.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28362025-03-08T00:49:00.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56867
28372025-03-08T00:49:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56532 req_id = c939b1ca-76e1-4a5b-a8b0-e5e07b265bd3 response_code = 204 uri = /eip-gateways
28382025-03-08T00:49:00.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52504 req_id = d221f20f-dad5-4ba1-a317-fe4aeda5afd2 response_code = 200 uri = /network-bootstore-config
28392025-03-08T00:49:00.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28402025-03-08T00:49:00.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50265 req_id = b244a2fd-9442-4a2f-8afe-06b11940d0c0 response_code = 200 uri = /v2p
28412025-03-08T00:49:00.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56532 req_id = 9b80f369-e243-4288-9861-c553e406ce44 response_code = 204 uri = /vpc-routes
28422025-03-08T00:49:00.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28432025-03-08T00:49:00.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56867 req_id = 4eda98ec-7460-4b9c-b921-6e2c774c9f4f response_code = 204 uri = /switch-ports
28442025-03-08T00:49:00.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56867 req_id = 87cad39b-2421-4185-bdf2-bb4feea81b9a response_code = 200 uri = /network-bootstore-config
28452025-03-08T00:49:00.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36445
28462025-03-08T00:49:00.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36445 req_id = 61b562c7-4579-43eb-8671-ec5de10a1c2d response_code = 200 uri = /v2p
28472025-03-08T00:49:00.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47809
28482025-03-08T00:49:00.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 412fe3ad-91b4-4c03-8453-8695d2fe00c3 response_code = 200 uri = /vpc-routes
28492025-03-08T00:49:00.897ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28502025-03-08T00:49:00.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 108ce93c-b80e-4c30-96fd-787f519c1c88 response_code = 204 uri = /eip-gateways
28512025-03-08T00:49:00.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47809 req_id = 9aa9e38a-ff79-405c-8e9e-c59ea0997678 response_code = 204 uri = /vpc-routes
28522025-03-08T00:49:00.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55537
28532025-03-08T00:49:00.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55537 req_id = 44296196-aec9-4d75-b5b1-eaaaacda6757 response_code = 200 uri = /v2p
28542025-03-08T00:49:01.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48683
28552025-03-08T00:49:01.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28562025-03-08T00:49:01.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28572025-03-08T00:49:01.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48683 req_id = 13b0940e-0440-48d4-aae0-e3d54f1901c3 response_code = 204 uri = /switch-ports
28582025-03-08T00:49:01.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48683 req_id = f8d9d8d9-c270-4e03-ae82-eaeb8a988997 response_code = 200 uri = /network-bootstore-config
28592025-03-08T00:49:11.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61608
28602025-03-08T00:49:11.165ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61608 req_id = 3127102d-ee1c-4e36-98b4-2e2a001633f0 response_code = 200 uri = /baseboard
28612025-03-08T00:49:12.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6755 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 9f52b0d1-4724-4eb5-9694-fcf1f4b1871a response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
28622025-03-08T00:49:14.351ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
28632025-03-08T00:49:14.351ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
28642025-03-08T00:49:14.351ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
28652025-03-08T00:49:14.352ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
28662025-03-08T00:49:30.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40736
28672025-03-08T00:49:30.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40736 req_id = 4fd719f9-45aa-486f-b079-664e98c188cb response_code = 200 uri = /vpc-routes
28682025-03-08T00:49:30.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39703
28692025-03-08T00:49:30.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39703 req_id = 97ac3a70-9122-48d5-81ef-dc6353c7d652 response_code = 200 uri = /vpc-routes
28702025-03-08T00:49:30.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28712025-03-08T00:49:30.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40736 req_id = 7d005d35-ac05-49af-a2f6-f6693733a4b3 response_code = 204 uri = /eip-gateways
28722025-03-08T00:49:30.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28732025-03-08T00:49:30.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39703 req_id = 8075de41-fc62-4174-b241-b7611ebfa8b8 response_code = 204 uri = /eip-gateways
28742025-03-08T00:49:30.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39703 req_id = ae62776f-2aa3-4f98-8748-693bfa88f18d response_code = 204 uri = /vpc-routes
28752025-03-08T00:49:30.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57028
28762025-03-08T00:49:30.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57028 req_id = aa2e6901-cf88-4018-9e03-c63dc2d4d06f response_code = 200 uri = /v2p
28772025-03-08T00:49:30.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35253
28782025-03-08T00:49:30.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28792025-03-08T00:49:30.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28802025-03-08T00:49:30.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35253 req_id = 7f1aad76-47a6-4044-a96b-c1666781afc7 response_code = 204 uri = /switch-ports
28812025-03-08T00:49:30.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37329
28822025-03-08T00:49:30.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57424
28832025-03-08T00:49:30.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35253 req_id = 13e06188-e99e-45e6-a9fb-41c3499a1070 response_code = 200 uri = /network-bootstore-config
28842025-03-08T00:49:30.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37329 req_id = ebe06174-301d-4506-bf64-84699d325a3f response_code = 200 uri = /v2p
28852025-03-08T00:49:30.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28862025-03-08T00:49:30.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6074 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40736 req_id = e62053a8-90c8-46c1-a6de-088abdae63bd response_code = 204 uri = /vpc-routes
28872025-03-08T00:49:31.021ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28882025-03-08T00:49:31.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57424 req_id = 461f7ec4-1377-465c-9e6f-803ce39ca830 response_code = 204 uri = /switch-ports
28892025-03-08T00:49:31.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57424 req_id = 463cd887-3d80-4066-b135-d12b4b902bf9 response_code = 200 uri = /network-bootstore-config
28902025-03-08T00:49:31.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45793
28912025-03-08T00:49:31.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45793 req_id = b6aa7c0a-1686-44ea-a37f-8ab437dcc825 response_code = 200 uri = /vpc-routes
28922025-03-08T00:49:31.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45143
28932025-03-08T00:49:31.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45143 req_id = d89cd3a5-2ab2-4ea3-a111-34de87df46c3 response_code = 200 uri = /v2p
28942025-03-08T00:49:31.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
28952025-03-08T00:49:31.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45793 req_id = f0af9c9d-f3a0-4b15-9d54-8ac14cadd1c7 response_code = 204 uri = /eip-gateways
28962025-03-08T00:49:31.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45793 req_id = 481614a3-0b5e-4c0b-ab2f-51d88f3c6755 response_code = 204 uri = /vpc-routes
28972025-03-08T00:49:31.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49059
28982025-03-08T00:49:31.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28992025-03-08T00:49:31.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29002025-03-08T00:49:31.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95018 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49059 req_id = b4202554-3d89-442a-80ad-d26bc53bb281 response_code = 204 uri = /switch-ports
29012025-03-08T00:49:31.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49059 req_id = 2e2f1bc7-9c22-4b01-9a32-a73cc2982220 response_code = 200 uri = /network-bootstore-config
29022025-03-08T00:49:41.196ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51166
29032025-03-08T00:49:41.197ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51166 req_id = 6dd91422-83ec-4da1-aad6-ded5c7af9489 response_code = 200 uri = /baseboard
29042025-03-08T00:49:42.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7384 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = c0502efc-7540-4df9-9d87-3edfad05c1c9 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
29052025-03-08T00:50:00.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56790
29062025-03-08T00:50:00.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56790 req_id = e1171c2e-d782-41f8-b238-f26e5725f83b response_code = 200 uri = /vpc-routes
29072025-03-08T00:50:00.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34514
29082025-03-08T00:50:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34514 req_id = f60e3087-6bf4-4f44-b631-cc8fcbe477b5 response_code = 200 uri = /vpc-routes
29092025-03-08T00:50:00.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
29102025-03-08T00:50:00.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56790 req_id = 940475f0-0794-47d7-af8c-3682049750e6 response_code = 204 uri = /eip-gateways
29112025-03-08T00:50:00.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56790 req_id = daa59874-d426-415b-89fb-c13f17e429b0 response_code = 204 uri = /vpc-routes
29122025-03-08T00:50:00.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
29132025-03-08T00:50:00.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34514 req_id = a05786d1-8dbb-450f-a3ec-4515b54b3d35 response_code = 204 uri = /eip-gateways
29142025-03-08T00:50:00.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46685
29152025-03-08T00:50:00.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46685 req_id = a5bc5b99-315e-4ba6-87d3-7e0a625de1ba response_code = 200 uri = /v2p
29162025-03-08T00:50:00.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34514 req_id = 7046b94c-2379-4f8c-a379-186f5c1a5e0a response_code = 204 uri = /vpc-routes
29172025-03-08T00:50:00.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47024
29182025-03-08T00:50:00.679ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29192025-03-08T00:50:00.729ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29202025-03-08T00:50:00.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47024 req_id = 200568e1-dec7-400b-bbb5-b3479c12345f response_code = 204 uri = /switch-ports
29212025-03-08T00:50:00.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63149
29222025-03-08T00:50:00.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49544
29232025-03-08T00:50:00.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47024 req_id = 185fa531-711f-4785-8e8c-044978573425 response_code = 200 uri = /network-bootstore-config
29242025-03-08T00:50:00.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49544 req_id = 56ce463b-d50f-495b-a89a-7eacf411950b response_code = 200 uri = /v2p
29252025-03-08T00:50:00.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29262025-03-08T00:50:00.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29272025-03-08T00:50:00.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63149 req_id = 73e12bff-c20f-4757-b20a-287f9ef135fc response_code = 204 uri = /switch-ports
29282025-03-08T00:50:00.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63149 req_id = ca607e7e-101e-4d75-b78d-964c823a7b0d response_code = 200 uri = /network-bootstore-config
29292025-03-08T00:50:00.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57412
29302025-03-08T00:50:00.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57412 req_id = 116a87fb-edd8-44b8-b0f6-f7a57c8cfdf9 response_code = 200 uri = /v2p
29312025-03-08T00:50:00.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52475
29322025-03-08T00:50:00.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52475 req_id = 08481796-6634-4ae9-a6be-5ef238b38613 response_code = 200 uri = /vpc-routes
29332025-03-08T00:50:00.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
29342025-03-08T00:50:00.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52475 req_id = bf21f524-6e1a-43cf-b2c7-f65f19d25664 response_code = 204 uri = /eip-gateways
29352025-03-08T00:50:00.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52475 req_id = 9a96685e-e72c-4d28-830a-98c7ccb72250 response_code = 204 uri = /vpc-routes
29362025-03-08T00:50:01.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37479
29372025-03-08T00:50:01.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29382025-03-08T00:50:01.078ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29392025-03-08T00:50:01.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37479 req_id = 6caff904-8834-473c-bfa8-37c58af9c67c response_code = 204 uri = /switch-ports
29402025-03-08T00:50:01.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37479 req_id = 721fdd84-0231-4a1a-ae7c-ef725d48f829 response_code = 200 uri = /network-bootstore-config
29412025-03-08T00:50:11.229ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49160
29422025-03-08T00:50:11.229ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49160 req_id = e0b142bd-aaa1-4967-9e6d-c7a67694be1f response_code = 200 uri = /baseboard
29432025-03-08T00:50:12.657ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6695 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = a9c497ab-4b63-4054-8493-f3cfb6a51a50 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
29442025-03-08T00:50:14.350ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
29452025-03-08T00:50:14.350ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
29462025-03-08T00:50:14.350ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
29472025-03-08T00:50:14.350ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
29482025-03-08T00:50:30.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56939
29492025-03-08T00:50:30.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56939 req_id = 3c83aa51-2120-4df3-ab49-c8ccddf422e0 response_code = 200 uri = /vpc-routes
29502025-03-08T00:50:30.598ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
29512025-03-08T00:50:30.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56939 req_id = 25656ef9-75e0-4448-ab1a-f5409530c07d response_code = 204 uri = /eip-gateways
29522025-03-08T00:50:30.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56939 req_id = af08cdcf-430c-4a83-965b-3fa0408a3a56 response_code = 204 uri = /vpc-routes
29532025-03-08T00:50:30.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33869
29542025-03-08T00:50:30.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29552025-03-08T00:50:30.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33869 req_id = 8786a610-9f54-4438-ac14-76fc64d8cef4 response_code = 200 uri = /artifacts
29562025-03-08T00:50:30.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42031
29572025-03-08T00:50:30.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42031 req_id = 193d5110-9a66-4418-9660-9f085550f1fe response_code = 200 uri = /vpc-routes
29582025-03-08T00:50:30.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35638
29592025-03-08T00:50:30.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29602025-03-08T00:50:30.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35638 req_id = cbdc466e-1c9d-4a67-bd29-28fb2f1368d8 response_code = 200 uri = /artifacts
29612025-03-08T00:50:30.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
29622025-03-08T00:50:30.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42031 req_id = d6fb1a32-241e-44a6-bd59-56b9730daa54 response_code = 204 uri = /eip-gateways
29632025-03-08T00:50:30.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42031 req_id = 9beb0bd3-839a-45b9-9784-c21bfa3b154f response_code = 204 uri = /vpc-routes
29642025-03-08T00:50:30.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44237
29652025-03-08T00:50:30.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44237 req_id = 08a150f0-6960-4e12-a298-2b6e017611e3 response_code = 200 uri = /v2p
29662025-03-08T00:50:30.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51462
29672025-03-08T00:50:30.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29682025-03-08T00:50:30.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29692025-03-08T00:50:30.970ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
29702025-03-08T00:50:30.971ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
29712025-03-08T00:50:30.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40918
29722025-03-08T00:50:30.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29732025-03-08T00:50:30.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29742025-03-08T00:50:30.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
29752025-03-08T00:50:31.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29762025-03-08T00:50:31.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
29772025-03-08T00:50:31.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29782025-03-08T00:50:31.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39662
29792025-03-08T00:50:31.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29802025-03-08T00:50:31.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
29812025-03-08T00:50:31.068ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29822025-03-08T00:50:31.068ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
29832025-03-08T00:50:31.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63192
29842025-03-08T00:50:31.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63192 req_id = d7961b86-a3f9-4679-9de4-8bcf6c68fd4d response_code = 200 uri = /v2p
29852025-03-08T00:50:31.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29862025-03-08T00:50:31.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40918 req_id = fa25a8ba-fe01-4f6e-a0f0-55bab6ac3e49 response_code = 204 uri = /switch-ports
29872025-03-08T00:50:31.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 847 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40918 req_id = bf9d0ad8-55a5-4679-b40e-4f109ea8d5eb response_code = 200 uri = /network-bootstore-config
29882025-03-08T00:50:31.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29892025-03-08T00:50:31.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
29902025-03-08T00:50:31.138ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29912025-03-08T00:50:31.138ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
29922025-03-08T00:50:31.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29932025-03-08T00:50:31.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29942025-03-08T00:50:31.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
29952025-03-08T00:50:31.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58990
29962025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29972025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29982025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29992025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30002025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
30012025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30022025-03-08T00:50:31.174ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30032025-03-08T00:50:31.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58990 req_id = b2c1e972-9414-40c6-aff6-754869223bba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
30042025-03-08T00:50:31.191ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30052025-03-08T00:50:31.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
30062025-03-08T00:50:31.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58761
30072025-03-08T00:50:31.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58761 req_id = 72bdda31-4b1d-411c-8fcb-dd3c2e8dee2a response_code = 200 uri = /vpc-routes
30082025-03-08T00:50:31.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 174289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39662 req_id = 909da398-77ed-40a7-bf35-6a85e763afb6 response_code = 204 uri = /switch-ports
30092025-03-08T00:50:31.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61764
30102025-03-08T00:50:31.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39662 req_id = 18dd53ca-566f-4a7d-a93a-2368bf174efd response_code = 200 uri = /network-bootstore-config
30112025-03-08T00:50:31.209ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30122025-03-08T00:50:31.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61764 req_id = 8f955ae4-71c7-4b84-8348-4f7e07c748f2 response_code = 200 uri = /artifacts
30132025-03-08T00:50:31.216ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30142025-03-08T00:50:31.216ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
30152025-03-08T00:50:31.221ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
30162025-03-08T00:50:31.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58761 req_id = 296776f8-d077-4c34-9c80-c26f6ad580a0 response_code = 204 uri = /eip-gateways
30172025-03-08T00:50:31.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 260649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51462 req_id = 40f5acbf-d870-4503-9ad3-56b31b028fdb response_code = 200 uri = /inventory
30182025-03-08T00:50:31.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50561
30192025-03-08T00:50:31.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30202025-03-08T00:50:31.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30212025-03-08T00:50:31.275ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
30222025-03-08T00:50:31.275ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
30232025-03-08T00:50:31.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30242025-03-08T00:50:31.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
30252025-03-08T00:50:31.311ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30262025-03-08T00:50:31.311ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
30272025-03-08T00:50:31.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46488
30282025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
30292025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30302025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30312025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30322025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
30332025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30342025-03-08T00:50:31.320ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30352025-03-08T00:50:31.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 439 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46488 req_id = ff512edc-ec19-4a21-9c9d-c72243652e36 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
30362025-03-08T00:50:31.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59831
30372025-03-08T00:50:31.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59831 req_id = fa5f3319-57eb-4371-9e25-994703c05587 response_code = 200 uri = /v2p
30382025-03-08T00:50:31.334ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30392025-03-08T00:50:31.334ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
30402025-03-08T00:50:31.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58761 req_id = dce60d06-7e6f-4393-8d87-4c9488f974c6 response_code = 204 uri = /vpc-routes
30412025-03-08T00:50:31.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61434
30422025-03-08T00:50:31.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
30432025-03-08T00:50:31.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30442025-03-08T00:50:31.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
30452025-03-08T00:50:31.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30462025-03-08T00:50:31.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
30472025-03-08T00:50:31.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
30482025-03-08T00:50:31.417ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30492025-03-08T00:50:31.417ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
30502025-03-08T00:50:31.441ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30512025-03-08T00:50:31.441ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
30522025-03-08T00:50:31.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108599 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61434 req_id = c76fc546-17fe-4339-a12f-9cca09c62d56 response_code = 204 uri = /switch-ports
30532025-03-08T00:50:31.471ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30542025-03-08T00:50:31.471ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
30552025-03-08T00:50:31.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61434 req_id = dc940586-21b9-488a-868d-fa0ad1eb895f response_code = 200 uri = /network-bootstore-config
30562025-03-08T00:50:31.500ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30572025-03-08T00:50:31.500ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
30582025-03-08T00:50:31.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 239452 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50561 req_id = 309e19d3-20dd-4880-a8eb-af815d233156 response_code = 200 uri = /inventory
30592025-03-08T00:50:31.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37350
30602025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4d0825be-9769-464b-9eb9-39c5eebe5d62, kind: Service { id: da0d8428-046e-431d-9a82-470b80ca232a }, name: Name("external-dns-da0d8428-046e-431d-9a82-470b80ca232a"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 176])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d157e977-c32e-4a22-a13f-9a7473eb90e5, kind: Service { id: 59287b7e-0d61-4586-b7c5-e79476927737 }, name: Name("external-dns-59287b7e-0d61-4586-b7c5-e79476927737"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0c3d6881-8d48-4d96-9ed0-85d27344279b, kind: Service { id: 4d603338-4154-45db-a26b-b6679dc7f0ec }, name: Name("nexus-4d603338-4154-45db-a26b-b6679dc7f0ec"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 106])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3723c067-03a8-4ed5-9a97-5c3ee10bca5c, kind: Service { id: 841ee309-4e1e-443f-ae06-2ad5eb454a8d }, name: Name("nexus-841ee309-4e1e-443f-ae06-2ad5eb454a8d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d79ffed2-490d-44d6-943a-e4d940d7938a, kind: Service { id: 8b94fb8b-b81f-40e3-a7d8-ae559205ae7f }, name: Name("nexus-8b94fb8b-b81f-40e3-a7d8-ae559205ae7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
30612025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30622025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30632025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30642025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
30652025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
30662025-03-08T00:50:31.557ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
30672025-03-08T00:50:31.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37350 req_id = 4b61350e-d36e-450b-bdf3-9c549d15f217 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
30682025-03-08T00:50:32.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65079
30692025-03-08T00:50:32.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30702025-03-08T00:50:32.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30712025-03-08T00:50:32.081ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/config/omicron-zones.json file = common/src/ledger.rs:175
30722025-03-08T00:50:32.081ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/config/omicron-zones.json file = common/src/ledger.rs:175
30732025-03-08T00:50:32.099ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30742025-03-08T00:50:32.099ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3
30752025-03-08T00:50:32.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 951704e7-65c1-4e81-81c5-ad2da67d30b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30762025-03-08T00:50:32.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_951704e7-65c1-4e81-81c5-ad2da67d30b2
30772025-03-08T00:50:32.142ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d5631626-73be-43f2-9e4f-e36e76615c9c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30782025-03-08T00:50:32.142ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d5631626-73be-43f2-9e4f-e36e76615c9c
30792025-03-08T00:50:32.161ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0013c1d-d815-4e4b-be96-32eb68284438 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30802025-03-08T00:50:32.161ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_e0013c1d-d815-4e4b-be96-32eb68284438
30812025-03-08T00:50:32.182ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f50d55fe-477d-42a7-afdb-d417b796d9e5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30822025-03-08T00:50:32.182ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f50d55fe-477d-42a7-afdb-d417b796d9e5
30832025-03-08T00:50:32.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6001475-9701-4229-b7ce-3f6b98ac1dd4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30842025-03-08T00:50:32.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_d6001475-9701-4229-b7ce-3f6b98ac1dd4
30852025-03-08T00:50:32.222ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9a0a4b5e-40a9-48fa-a969-b15e90919159 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30862025-03-08T00:50:32.222ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9a0a4b5e-40a9-48fa-a969-b15e90919159
30872025-03-08T00:50:32.242ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0c297b73-9ba6-4e74-86dd-6b121c1c8a08 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30882025-03-08T00:50:32.242ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0c297b73-9ba6-4e74-86dd-6b121c1c8a08
30892025-03-08T00:50:32.263ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0def2502-81eb-4b14-9f26-5ae960188d32 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30902025-03-08T00:50:32.263ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_0def2502-81eb-4b14-9f26-5ae960188d32
30912025-03-08T00:50:32.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 193460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65079 req_id = bdd128f3-3125-4b7d-9767-99e69aaf3e4c response_code = 200 uri = /inventory
30922025-03-08T00:50:41.262ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63067
30932025-03-08T00:50:41.262ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63067 req_id = 886fcf71-853c-40c9-9459-2bde0343dcff response_code = 200 uri = /baseboard
30942025-03-08T00:50:42.656ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6601 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 112ff1fd-f8b2-4b81-979c-d3631b4916d1 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
30952025-03-08T00:50:54.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54189
30962025-03-08T00:50:54.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54189 req_id = f2115527-8eae-4629-83c7-47f929c60743 response_code = 200 uri = /v2p
30972025-03-08T00:50:54.772ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(13441751) }
30982025-03-08T00:50:54.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54189 req_id = 51cc02f9-81ae-4a1b-a71c-2175a1c3befe response_code = 204 uri = /v2p
30992025-03-08T00:50:54.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59534
31002025-03-08T00:50:54.854ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13441751))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 3b22cbcb-9927-4cd1-bef7-6d3e467096be, slot: 0, read_only: false, vcr_json: .., name: "disk-1acdbd07bdb" }], boot_settings: Some(InstanceBootSettings { order: [3b22cbcb-9927-4cd1-bef7-6d3e467096be] }), cloud_init_bytes: Some(..) } instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d metadata = InstanceMetadata { silo_id: 5903a422-2123-4b6a-9e2a-1da7d551206b, project_id: 3b59e42e-8aa7-499a-a283-a107ad23826a } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-08T00:50:54.850840242Z }
31012025-03-08T00:50:54.855ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d migration_id = None propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31022025-03-08T00:50:54.855ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d migration_id = None propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(13441751))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: efd04917-3123-4423-a590-74a40f32a6ed, kind: Instance { id: 6c0adf12-3120-40cb-8319-60c76e95db9d }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(13441751), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 3b22cbcb-9927-4cd1-bef7-6d3e467096be, slot: 0, read_only: false, vcr_json: .., name: "disk-1acdbd07bdb" }], boot_settings: Some(InstanceBootSettings { order: [3b22cbcb-9927-4cd1-bef7-6d3e467096be] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-08T00:50:54.850840242Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31032025-03-08T00:50:54.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59534 req_id = 7fffff45-5b57-4ce1-80ab-519fddc05770 response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21
31042025-03-08T00:50:54.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51860
31052025-03-08T00:50:54.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 709 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51860 req_id = e6156cf1-2d84-4e40-a546-372a3ee07021 response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21/state
31062025-03-08T00:50:54.969ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 13441751 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31072025-03-08T00:50:54.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31082025-03-08T00:50:55.010ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21 file = illumos-utils/src/zone.rs:327 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31092025-03-08T00:50:55.034ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21 file = illumos-utils/src/zone.rs:365 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31102025-03-08T00:50:55.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57645
31112025-03-08T00:50:55.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57645 req_id = a381dadd-ab92-4ae1-b3ab-4cec243949af response_code = 200 uri = /vpc-routes
31122025-03-08T00:50:55.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {efd04917-3123-4423-a590-74a40f32a6ed: {10.151.2.176: {69e9d00b-ef75-41a7-ad47-501e75752c8d}, 10.151.2.175: {69e9d00b-ef75-41a7-ad47-501e75752c8d}}} }
31132025-03-08T00:50:56.552ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31142025-03-08T00:50:56.553ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21 zone file = illumos-utils/src/running_zone.rs:491 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31152025-03-08T00:50:56.815ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 62.981452ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31162025-03-08T00:50:56.906ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 63.497308ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31172025-03-08T00:50:56.984ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 101.078479ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31182025-03-08T00:50:57.101ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 313.896933ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31192025-03-08T00:50:57.431ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 1.177867897s file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31202025-03-08T00:50:58.621ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 1.23560674s file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31212025-03-08T00:50:59.870ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 1.359748001s file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31222025-03-08T00:51:00.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35543
31232025-03-08T00:51:00.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35543 req_id = 731d7949-45b3-42c3-8334-2cc4db8a8f74 response_code = 200 uri = /vpc-routes
31242025-03-08T00:51:00.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41019
31252025-03-08T00:51:00.576ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {efd04917-3123-4423-a590-74a40f32a6ed: {10.151.2.176: {69e9d00b-ef75-41a7-ad47-501e75752c8d}, 10.151.2.175: {69e9d00b-ef75-41a7-ad47-501e75752c8d}}} }
31262025-03-08T00:51:00.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 766 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35543 req_id = c2f0fad9-dbad-4406-a962-e7841ee29326 response_code = 204 uri = /eip-gateways
31272025-03-08T00:51:00.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57548
31282025-03-08T00:51:00.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50265
31292025-03-08T00:51:00.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
31302025-03-08T00:51:00.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
31312025-03-08T00:51:00.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50265 req_id = 5eafd6d8-fb6e-427f-9506-c26220e24e9d response_code = 204 uri = /switch-ports
31322025-03-08T00:51:00.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33074
31332025-03-08T00:51:00.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64913
31342025-03-08T00:51:00.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50265 req_id = 6560ec91-10b6-471e-b3dc-21119cb71b03 response_code = 200 uri = /network-bootstore-config
31352025-03-08T00:51:00.778ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
31362025-03-08T00:51:00.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59515
31372025-03-08T00:51:00.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59515 req_id = fcc335e2-b5f7-4316-bded-21e60f6e51d5 response_code = 200 uri = /v2p
31382025-03-08T00:51:00.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49170
31392025-03-08T00:51:00.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49170 req_id = 1f59da18-4d2b-45a8-8819-b1c9514dd332 response_code = 200 uri = /v2p
31402025-03-08T00:51:00.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
31412025-03-08T00:51:00.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61928
31422025-03-08T00:51:00.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61928 req_id = ddd48824-e06a-4982-bebd-349d750829ed response_code = 200 uri = /vpc-routes
31432025-03-08T00:51:00.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33074 req_id = 2329df5e-7cb7-48b5-85d3-6ee10ecaab2d response_code = 204 uri = /switch-ports
31442025-03-08T00:51:00.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33074 req_id = 1a0a97ec-c400-4f1b-8091-efa9e121ec7f response_code = 200 uri = /network-bootstore-config
31452025-03-08T00:51:00.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {efd04917-3123-4423-a590-74a40f32a6ed: {10.151.2.175: {69e9d00b-ef75-41a7-ad47-501e75752c8d}, 10.151.2.176: {69e9d00b-ef75-41a7-ad47-501e75752c8d}}} }
31462025-03-08T00:51:00.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61928 req_id = 709f1398-0fc5-44c0-be84-d1269b5f49d0 response_code = 204 uri = /eip-gateways
31472025-03-08T00:51:00.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35543 req_id = 4a58a6ec-ecd6-46a9-9722-e6777a8f27a9 response_code = 204 uri = /vpc-routes
31482025-03-08T00:51:00.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54133
31492025-03-08T00:51:00.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
31502025-03-08T00:51:01.002ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
31512025-03-08T00:51:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 118304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54133 req_id = 5b2d882b-2f94-4ffd-ad96-18b8ccc12119 response_code = 204 uri = /switch-ports
31522025-03-08T00:51:01.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54133 req_id = bf48a715-2fe1-420b-9ed4-4d784bd2fec5 response_code = 200 uri = /network-bootstore-config
31532025-03-08T00:51:01.093ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 9f763912-569c-447c-ab9d-133c00d90394, version: 3 } old_vers = RouterVersion { router_id: 9f763912-569c-447c-ab9d-133c00d90394, version: 3 } subnet = RouterId { vni: Vni(13441751), kind: System }
31542025-03-08T00:51:01.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 458 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61928 req_id = f39fa488-0ec7-4fe9-b2dc-21f2fa07dba6 response_code = 204 uri = /vpc-routes
31552025-03-08T00:51:01.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57133
31562025-03-08T00:51:01.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57133 req_id = beb146e8-c09d-4b81-94ee-375be7dfe9e6 response_code = 200 uri = /v2p
31572025-03-08T00:51:01.242ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 652.145184ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 zone = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
31582025-03-08T00:51:01.928ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21 file = sled-agent/src/instance.rs:2133 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31592025-03-08T00:51:01.937ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 64.038694ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31602025-03-08T00:51:02.013ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 90.285438ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31612025-03-08T00:51:02.117ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 150.82716ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31622025-03-08T00:51:02.278ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21") failed: Property not found. retry in 339.742573ms file = illumos-utils/src/svc.rs:42 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31632025-03-08T00:51:02.630ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31642025-03-08T00:51:02.669ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31652025-03-08T00:51:02.751ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31662025-03-08T00:51:02.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1975167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64913 req_id = e9ac032a-c9e1-4f00-b36b-27bd29c4b59c response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21/state
31672025-03-08T00:51:02.753ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
31682025-03-08T00:51:02.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41019 req_id = 6730d941-8032-41a4-a772-47feca0053fd response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21/state
31692025-03-08T00:51:02.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7636751 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57645 req_id = 4c48449e-8623-4901-b7ad-b5c32da19240 response_code = 204 uri = /eip-gateways
31702025-03-08T00:51:02.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2155405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57548 req_id = eb0f8895-f0bc-4960-b8bd-13ea1197bcfb response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21/state
31712025-03-08T00:51:02.753ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-08T00:51:02.753458693Z } file = sled-agent/src/instance.rs:842 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31722025-03-08T00:51:02.753ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-08T00:51:02.753458693Z } propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31732025-03-08T00:51:02.753ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-08T00:51:02.753458693Z }, migration_in: None, migration_out: None }
31742025-03-08T00:51:02.804ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-08T00:51:02.804044921Z } file = sled-agent/src/instance.rs:842 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31752025-03-08T00:51:02.804ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-08T00:51:02.804044921Z } propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31762025-03-08T00:51:02.804ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-08T00:51:02.804044921Z }, migration_in: None, migration_out: None }
31772025-03-08T00:51:02.942ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 9f763912-569c-447c-ab9d-133c00d90394, version: 3 } old_vers = RouterVersion { router_id: 9f763912-569c-447c-ab9d-133c00d90394, version: 3 } subnet = RouterId { vni: Vni(13441751), kind: System }
31782025-03-08T00:51:02.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57645 req_id = 6881f475-d926-4b0e-897c-098b1b5c074b response_code = 204 uri = /vpc-routes
31792025-03-08T00:51:03.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46297
31802025-03-08T00:51:03.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46297 req_id = 4f098411-cf4f-4d1a-ba27-14b49863cc37 response_code = 200 uri = /vpc-routes
31812025-03-08T00:51:03.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {efd04917-3123-4423-a590-74a40f32a6ed: {10.151.2.175: {69e9d00b-ef75-41a7-ad47-501e75752c8d}, 10.151.2.176: {69e9d00b-ef75-41a7-ad47-501e75752c8d}}} }
31822025-03-08T00:51:03.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46297 req_id = 594a2826-cb1c-46d3-896e-77639de91274 response_code = 204 uri = /eip-gateways
31832025-03-08T00:51:03.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46297 req_id = 73dab06c-33a2-4b8a-a34f-39f3477ffe3c response_code = 204 uri = /vpc-routes
31842025-03-08T00:51:11.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56154
31852025-03-08T00:51:11.294ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56154 req_id = 28e2400b-a7c6-4847-a3b8-50643b094e8b response_code = 200 uri = /baseboard
31862025-03-08T00:51:12.658ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8233 local_addr = [fd00:1122:3344:101::1]:39407 method = GET remote_addr = [fd00:1122:3344:101::d]:59267 req_id = 3c4d69de-55e4-4413-8056-bc1e6c57dbc1 response_code = 200 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c uri = /87826585-0843-40d2-a3ce-382fa54dbc5c
31872025-03-08T00:51:12.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62569
31882025-03-08T00:51:12.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 467 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62569 req_id = cbbb7ed8-5565-4126-b12a-3d077afdd4a9 response_code = 200 uri = /vmms/de771ab5-f863-4317-9c0b-66d2cc459f21/state
31892025-03-08T00:51:12.997ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-08T00:51:12.997173088Z } file = sled-agent/src/instance.rs:842 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31902025-03-08T00:51:12.997ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-08T00:51:12.997173088Z } propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31912025-03-08T00:51:12.997ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-08T00:51:12.997173088Z }, migration_in: None, migration_out: None }
31922025-03-08T00:51:13.012ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-08T00:51:13.012506847Z } file = sled-agent/src/instance.rs:842 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31932025-03-08T00:51:13.012ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-08T00:51:13.012506847Z } propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31942025-03-08T00:51:13.012ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
31952025-03-08T00:51:13.012ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31962025-03-08T00:51:13.013ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6564154226108493386 n_samples = 6 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
31972025-03-08T00:51:13.013ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 15743329146579224547 n_samples = 6 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
31982025-03-08T00:51:13.013ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31992025-03-08T00:51:13.013ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/450bd53e-d8ef-41a8-8d61-35c259ce6831/debug/bundle/zone", "/pool/int/522901ce-0715-43a8-8d70-a8fac8d50c94/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/52b15b2d-6fb2-4f1a-9e6d-9e2af5f324f3/crypt/debug", "/pool/ext/951704e7-65c1-4e81-81c5-ad2da67d30b2/crypt/debug", "/pool/ext/d5631626-73be-43f2-9e4f-e36e76615c9c/crypt/debug", "/pool/ext/e0013c1d-d815-4e4b-be96-32eb68284438/crypt/debug", "/pool/ext/f50d55fe-477d-42a7-afdb-d417b796d9e5/crypt/debug", "/pool/ext/d6001475-9701-4229-b7ce-3f6b98ac1dd4/crypt/debug", "/pool/ext/9a0a4b5e-40a9-48fa-a969-b15e90919159/crypt/debug", "/pool/ext/0c297b73-9ba6-4e74-86dd-6b121c1c8a08/crypt/debug", "/pool/ext/0def2502-81eb-4b14-9f26-5ae960188d32/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:354 zone_name = oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21
32002025-03-08T00:51:13.686ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1159 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21", bundle_id: 2365924f-0052-4d24-a3c5-b1afe1e1d0e5 }, time_created: 2025-03-08T00:51:13.013925242Z, version: 0, cause: TerminatedInstance }
32012025-03-08T00:51:13.686ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_de771ab5-f863-4317-9c0b-66d2cc459f21 file = sled-agent/src/instance.rs:1376 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
32022025-03-08T00:51:14.350ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
32032025-03-08T00:51:14.351ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
32042025-03-08T00:51:14.351ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
32052025-03-08T00:51:14.351ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
32062025-03-08T00:51:15.430ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:281 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
32072025-03-08T00:51:15.447ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(13441751), kind: System }
32082025-03-08T00:51:15.447ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(13441751), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
32092025-03-08T00:51:15.448ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-08T00:51:15.448152094Z }, migration_in: None, migration_out: None }
32102025-03-08T00:51:15.478ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-08T00:51:15.448152094Z }, migration_in: None, migration_out: None }
32112025-03-08T00:51:15.483ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 6c0adf12-3120-40cb-8319-60c76e95db9d propolis_id = de771ab5-f863-4317-9c0b-66d2cc459f21
32122025-03-08T00:51:15.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60732
32132025-03-08T00:51:15.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60732 req_id = 801b8bbf-a014-4949-a242-3de9ef3d7af4 response_code = 200 uri = /vpc-routes
32142025-03-08T00:51:15.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {efd04917-3123-4423-a590-74a40f32a6ed: {10.151.2.175: {69e9d00b-ef75-41a7-ad47-501e75752c8d}, 10.151.2.176: {69e9d00b-ef75-41a7-ad47-501e75752c8d}}} }
32152025-03-08T00:51:15.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60732 req_id = 91600940-f239-4266-84dc-1fde3333c061 response_code = 204 uri = /eip-gateways
32162025-03-08T00:51:16.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60732 req_id = 7d671131-f136-4ef3-8c61-0b8e00d32800 response_code = 204 uri = /vpc-routes
32172025-03-08T00:51:16.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60996
32182025-03-08T00:51:16.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60996 req_id = 077ca45a-2004-438a-ba83-6001a381659a response_code = 200 uri = /v2p
32192025-03-08T00:51:16.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61023
32202025-03-08T00:51:16.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61023 req_id = cfb59c91-36cb-4860-98a4-80435c3f83a7 response_code = 200 uri = /v2p
32212025-03-08T00:51:16.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64574
32222025-03-08T00:51:16.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64574 req_id = 0edb5fd9-917f-44cd-9dc6-f90b2a3ff28f response_code = 200 uri = /vpc-routes
32232025-03-08T00:51:16.823ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
32242025-03-08T00:51:16.823ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c
32252025-03-08T00:51:16.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64574 req_id = a7df03eb-e35b-487c-b6ce-ebc4d4a01ea7 response_code = 204 uri = /eip-gateways
32262025-03-08T00:51:16.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64574 req_id = 0d30c716-ca02-4cd0-85f4-563240b4900f response_code = 204 uri = /vpc-routes
32272025-03-08T00:51:17.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45844
32282025-03-08T00:51:17.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45844 req_id = 5a03f633-406b-4d43-836c-bf03ed788e6a response_code = 200 uri = /vpc-routes
32292025-03-08T00:51:17.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 87826585-0843-40d2-a3ce-382fa54dbc5c values = ExternalIpGatewayMap { mappings: {} }
32302025-03-08T00:51:17.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45844 req_id = ee1ae5ce-1576-4525-9953-b8851afcb399 response_code = 204 uri = /eip-gateways
32312025-03-08T00:51:17.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45844 req_id = 95aa8b29-b442-447d-bac9-3cfe142e6cbc response_code = 204 uri = /vpc-routes