Max level shown:
1 [ Mar 7 22:31:29 Enabled. ]
2 [ Mar 7 22:31:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Mar 7 22:31:29 Method "start" exited with status 0. ]
4 [ Mar 7 22:31:29 Rereading configuration. ]
5 [ Mar 7 22:31:29 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-03-07T22:31:29.234ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:115
82025-03-07T22:31:29.235ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:248
92025-03-07T22:31:29.289ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:255
102025-03-07T22:31:29.289ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-03-07T22:31:29.403ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-03-07T22:31:29.412ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-03-07T22:31:29.420ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:265 path = /var/run/oxide/
142025-03-07T22:31:30.033ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
152025-03-07T22:31:30.035ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }]
162025-03-07T22:31:30.035ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
172025-03-07T22:31:30.165ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
182025-03-07T22:31:30.165ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
192025-03-07T22:31:30.165ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
202025-03-07T22:31:30.165ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:528
212025-03-07T22:31:30.165ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
222025-03-07T22:31:30.165ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
232025-03-07T22:31:30.168ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
242025-03-07T22:31:30.168ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
252025-03-07T22:31:30.168ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
262025-03-07T22:31:30.168ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:828
272025-03-07T22:31:30.168ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
282025-03-07T22:31:30.168ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
292025-03-07T22:31:30.168ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
302025-03-07T22:31:30.168ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
312025-03-07T22:31:30.168ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
322025-03-07T22:31:30.180ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:369
332025-03-07T22:31:30.180ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool)
342025-03-07T22:31:30.279ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal }
352025-03-07T22:31:30.657ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
362025-03-07T22:31:30.657ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
372025-03-07T22:31:30.657ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
382025-03-07T22:31:30.657ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
392025-03-07T22:31:30.657ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
402025-03-07T22:31:30.657ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
412025-03-07T22:31:30.657ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
422025-03-07T22:31:30.666ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:369
432025-03-07T22:31:30.666ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:380 id = 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool)
442025-03-07T22:31:30.755ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal }
452025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
462025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
472025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
482025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
492025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
502025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
512025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
522025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
542025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
552025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
562025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
572025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
592025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
602025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
612025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
622025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
632025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
642025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
662025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
672025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
682025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
692025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
702025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
722025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
732025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
742025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
752025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
762025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
782025-03-07T22:31:31.129ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
792025-03-07T22:31:31.129ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
802025-03-07T22:31:31.129ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
812025-03-07T22:31:31.129ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
822025-03-07T22:31:31.129ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-03-07T22:31:31.130ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-03-07T22:31:31.130ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
862025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
872025-03-07T22:31:31.130ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
882025-03-07T22:31:31.130ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
902025-03-07T22:31:31.130ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
912025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
922025-03-07T22:31:31.130ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
932025-03-07T22:31:31.130ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
942025-03-07T22:31:31.130ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-03-07T22:31:31.130ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
972025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
982025-03-07T22:31:31.130ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
992025-03-07T22:31:31.130ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1002025-03-07T22:31:31.130ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
1022025-03-07T22:31:31.130ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
1032025-03-07T22:31:31.130ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1042025-03-07T22:31:31.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1052025-03-07T22:31:31.130ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1062025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1072025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1082025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1092025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1102025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/cluster/bootstore-network-config.json file = common/src/ledger.rs:186 peer_id = pc-buskin-i86pc
1112025-03-07T22:31:31.130ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1122025-03-07T22:31:31.130ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1132025-03-07T22:31:31.130ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1142025-03-07T22:31:31.141ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:794
1152025-03-07T22:31:31.141ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:208 next_cleanup = Instant { tv_sec: 1249, tv_nsec: 549148046 } time_to_next_cleanup = 599.999919349s
1162025-03-07T22:31:31.141ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
1172025-03-07T22:31:31.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1182025-03-07T22:31:31.141ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/sled-agent-request.json file = common/src/ledger.rs:186
1192025-03-07T22:31:31.141ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/sled-agent-request.json file = common/src/ledger.rs:186
1202025-03-07T22:31:31.144ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1212025-03-07T22:31:31.146ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1222025-03-07T22:31:31.146ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1257
1232025-03-07T22:31:31.146ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1242025-03-07T22:31:31.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1252025-03-07T22:31:31.146ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1262025-03-07T22:31:31.146ZINFOSledAgent (RSS): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/rss-started.marker file = common/src/ledger.rs:186
1272025-03-07T22:31:31.146ZINFOSledAgent (RSS): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/rss-started.marker file = common/src/ledger.rs:186
1282025-03-07T22:31:31.146ZINFOSledAgent (RSS): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1292025-03-07T22:31:31.146ZINFOSledAgent (RSS): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/rss-plan-completed.marker file = common/src/ledger.rs:186
1302025-03-07T22:31:31.146ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1306
1312025-03-07T22:31:31.146ZINFOSledAgent (RSS): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1322025-03-07T22:31:31.146ZINFOSledAgent (RSS): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.rss-started.marker.tmp file = common/src/ledger.rs:197
1332025-03-07T22:31:31.146ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1338
1342025-03-07T22:31:31.146ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1352025-03-07T22:31:31.146ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1362025-03-07T22:31:31.146ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1369
1372025-03-07T22:31:31.147ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382025-03-07T22:31:31.147ZINFOSledAgent (bootstore): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1392025-03-07T22:31:31.147ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
1402025-03-07T22:31:31.147ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412025-03-07T22:31:31.147ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 (sled), rack_id: 82e3cdb7-0f87-46cf-98cd-832919b5c7ec, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422025-03-07T22:31:31.148ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4319
1432025-03-07T22:31:31.148ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4740
1442025-03-07T22:31:31.153ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/client.rs:50
1452025-03-07T22:31:31.159ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1462025-03-07T22:31:31.159ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1472025-03-07T22:31:31.163ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:307
1482025-03-07T22:31:31.163ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-882d17aeeb0cb343/6d31fa6/tls/src/keys.rs:376
1492025-03-07T22:31:31.163ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38544
1502025-03-07T22:31:31.163ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 (sled), rack_id: 82e3cdb7-0f87-46cf-98cd-832919b5c7ec, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:358
1512025-03-07T22:31:31.163ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:373
1522025-03-07T22:31:31.163ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532025-03-07T22:31:31.163ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1552025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1562025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1572025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = load_disks_ledger
1582025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1592025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1602025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1612025-03-07T22:31:31.163ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1622025-03-07T22:31:31.163ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1632025-03-07T22:31:31.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-03-07T22:31:31.200ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:327
1652025-03-07T22:31:31.214ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:419 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1662025-03-07T22:31:31.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-03-07T22:31:31.214ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:431 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1682025-03-07T22:31:31.214ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
1692025-03-07T22:31:31.217ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:365
1702025-03-07T22:31:31.220ZWARNSledAgent (DdmReconciler): failed to enable stats error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ef14c335-1da1-4bfd-9691-6ed34025798a", "content-length": "124", "date": "Fri, 07 Mar 2025 22:31:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ef14c335-1da1-4bfd-9691-6ed34025798a" } file = sled-agent/src/ddm_reconciler.rs:193
1712025-03-07T22:31:31.220ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
1722025-03-07T22:31:31.221ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }]
1732025-03-07T22:31:31.221ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
1742025-03-07T22:31:31.227ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_66abaaaf-daa5-4de4-bd67-09c153a40921/swap", size_gb=64 file = sled-agent/src/swap_device.rs:155
1752025-03-07T22:31:31.251ZINFOSledAgent: successfully created encrypted zvol: name="oxi_66abaaaf-daa5-4de4-bd67-09c153a40921/swap", size_gb=64 file = sled-agent/src/swap_device.rs:253
1762025-03-07T22:31:31.252ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_66abaaaf-daa5-4de4-bd67-09c153a40921/swap" file = sled-agent/src/swap_device.rs:98
1772025-03-07T22:31:31.257ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:446 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1782025-03-07T22:31:31.257ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1792025-03-07T22:31:31.257ZINFOSledAgent (BackingFs): Ensuring dataset oxi_66abaaaf-daa5-4de4-bd67-09c153a40921/backing/fmd file = sled-agent/src/backing_fs.rs:139
1802025-03-07T22:31:31.324ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1812025-03-07T22:31:31.543ZINFOSledAgent (BackingFs): Mounting oxi_66abaaaf-daa5-4de4-bd67-09c153a40921/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-03-07T22:31:31.555ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-03-07T22:31:31.556ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-03-07T22:31:31.556ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-03-07T22:31:31.556ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-03-07T22:31:32.303ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:94 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1872025-03-07T22:31:32.309ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:63164 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1882025-03-07T22:31:32.309ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1892025-03-07T22:31:32.309ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:63164 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1902025-03-07T22:31:32.310ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 369.895277ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1912025-03-07T22:31:32.311ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:265 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1922025-03-07T22:31:32.311ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:273 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1932025-03-07T22:31:32.311ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:981 underlay_address = fd00:1122:3344:101::1
1942025-03-07T22:31:32.311ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1952025-03-07T22:31:32.682ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 740.389378ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1962025-03-07T22:31:33.424ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 994.335579ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1972025-03-07T22:31:34.419ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.946883764s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
1982025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2737
1992025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2967
2002025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2607
2012025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2654
2022025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3048
2032025-03-07T22:31:35.300ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3093
2042025-03-07T22:31:35.302ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2875
2052025-03-07T22:31:35.303ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2648
2062025-03-07T22:31:35.303ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b3acd2ea-cc56-4d70-9eae-10bb247cbb64'/> <propval type="astring" name="rack_id" value='82e3cdb7-0f87-46cf-98cd-832919b5c7ec'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feb9:77fc'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='82e3cdb7-0f87-46cf-98cd-832919b5c7ec'/> <propval type="astring" name="sled_id" value='73b218dd-7dbc-4345-acb1-fe69ced4a7f7'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='82e3cdb7-0f87-46cf-98cd-832919b5c7ec'/> <propval type="astring" name="sled_id" value='73b218dd-7dbc-4345-acb1-fe69ced4a7f7'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='73b218dd-7dbc-4345-acb1-fe69ced4a7f7'/> <propval type="astring" name="rack_uuid" value='82e3cdb7-0f87-46cf-98cd-832919b5c7ec'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='73b218dd-7dbc-4345-acb1-fe69ced4a7f7'/> <propval type="astring" name="rack_uuid" value='82e3cdb7-0f87-46cf-98cd-832919b5c7ec'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2072025-03-07T22:31:35.303ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_switch
2082025-03-07T22:31:35.595ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 51.639884ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2092025-03-07T22:31:35.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 82.52738ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2102025-03-07T22:31:35.989ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 211.546009ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2112025-03-07T22:31:36.373ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 521.371395ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2122025-03-07T22:31:37.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 982.456049ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-03-07T22:31:37.370ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.684036781s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2142025-03-07T22:31:38.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.452658902s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2152025-03-07T22:31:39.766ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 632.75903ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-03-07T22:31:40.446ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_switch") failed: Property not found. retry in 1.082485369s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-03-07T22:31:42.118ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2182025-03-07T22:31:42.119ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2192025-03-07T22:31:42.120ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2202025-03-07T22:31:42.120ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:423
2212025-03-07T22:31:42.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2222025-03-07T22:31:42.120ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2232025-03-07T22:31:42.120ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:197
2242025-03-07T22:31:42.121ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2252025-03-07T22:31:42.121ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:38544
2262025-03-07T22:31:42.121ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2272025-03-07T22:31:42.121ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4022
2282025-03-07T22:31:42.299ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2292025-03-07T22:31:42.300ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2302025-03-07T22:31:42.305ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4343 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2312025-03-07T22:31:42.305ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4359
2322025-03-07T22:31:42.305ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:537 zone = oxz_switch
2332025-03-07T22:31:42.513ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10678064581314328160 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2342025-03-07T22:31:42.513ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:277 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2352025-03-07T22:31:42.513ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13224156581830762376 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2362025-03-07T22:31:42.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42480
2372025-03-07T22:31:42.543ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2382025-03-07T22:31:42.543ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2392025-03-07T22:31:42.543ZINFOSledAgent (ServiceManager): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:186
2402025-03-07T22:31:42.543ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:186
2412025-03-07T22:31:42.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42480 req_id = 36e54e2d-81e5-43a8-bf49-c9bf489654b5 response_code = 200 uri = /inventory
2422025-03-07T22:31:42.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39967
2432025-03-07T22:31:42.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39967 req_id = bea71b93-9e5a-40c9-bd70-06291d01afdd response_code = 200 uri = /sled-role
2442025-03-07T22:31:42.604ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 08dbb931-70bb-43d1-84fd-68566e16323c (physical_disk), pool_id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3282bbb9-15ef-4820-ab3d-8d1e6ef33e6c (physical_disk), pool_id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 331241ae-9644-43ce-b63a-80e1061d6a70 (physical_disk), pool_id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 51596b35-c30b-4641-b285-25d5781764ab (physical_disk), pool_id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 68c7a40c-811e-4dc6-822d-b2e802259477 (physical_disk), pool_id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6ec13e51-30e6-463b-b373-fe7cf7429ddf (physical_disk), pool_id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7c06f462-7aa4-453f-a45f-f1c8d39f36d5 (physical_disk), pool_id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7da16cf3-6fa9-4693-8395-0af6007c98c0 (physical_disk), pool_id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 93140bef-245e-49b2-82c8-a7ca37279892 (physical_disk), pool_id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool) }] } file = sled-agent/src/rack_setup/service.rs:399 sled_address = [fd00:1122:3344:101::1]:12345
2452025-03-07T22:31:42.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44057
2462025-03-07T22:31:42.605ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2472025-03-07T22:31:42.605ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 08dbb931-70bb-43d1-84fd-68566e16323c (physical_disk), pool_id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3282bbb9-15ef-4820-ab3d-8d1e6ef33e6c (physical_disk), pool_id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 331241ae-9644-43ce-b63a-80e1061d6a70 (physical_disk), pool_id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 51596b35-c30b-4641-b285-25d5781764ab (physical_disk), pool_id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 68c7a40c-811e-4dc6-822d-b2e802259477 (physical_disk), pool_id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6ec13e51-30e6-463b-b373-fe7cf7429ddf (physical_disk), pool_id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7c06f462-7aa4-453f-a45f-f1c8d39f36d5 (physical_disk), pool_id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 7da16cf3-6fa9-4693-8395-0af6007c98c0 (physical_disk), pool_id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 93140bef-245e-49b2-82c8-a7ca37279892 (physical_disk), pool_id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2482025-03-07T22:31:42.605ZINFOSledAgent (StorageManager): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2492025-03-07T22:31:42.605ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-physical-disks.json file = common/src/ledger.rs:186 request = omicron_physical_disks_ensure
2502025-03-07T22:31:42.605ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1301 request = omicron_physical_disks_ensure
2512025-03-07T22:31:42.605ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2522025-03-07T22:31:42.605ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2532025-03-07T22:31:42.605ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2542025-03-07T22:31:42.605ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2552025-03-07T22:31:42.615ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:369
2562025-03-07T22:31:42.615ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool)
2572025-03-07T22:31:42.712ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }
2582025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:241
2592025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:243
2602025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2612025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:249
2622025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2632025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2642025-03-07T22:31:42.721ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2652025-03-07T22:31:42.756ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2662025-03-07T22:31:42.765ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone file = sled-storage/src/dataset.rs:304
2672025-03-07T22:31:42.904ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe file = sled-storage/src/dataset.rs:390
2682025-03-07T22:31:42.912ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2692025-03-07T22:31:42.912ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2702025-03-07T22:31:42.912ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2712025-03-07T22:31:42.912ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2722025-03-07T22:31:42.912ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2732025-03-07T22:31:42.921ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:369
2742025-03-07T22:31:42.921ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool)
2752025-03-07T22:31:43.012ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }
2762025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:241
2772025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:243
2782025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2792025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:249
2802025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2812025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2822025-03-07T22:31:43.022ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
2832025-03-07T22:31:43.056ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.727683106s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2842025-03-07T22:31:43.057ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2852025-03-07T22:31:43.065ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone file = sled-storage/src/dataset.rs:304
2862025-03-07T22:31:43.122ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
2872025-03-07T22:31:43.201ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19 file = sled-storage/src/dataset.rs:390
2882025-03-07T22:31:43.208ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2892025-03-07T22:31:43.208ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2902025-03-07T22:31:43.208ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2912025-03-07T22:31:43.208ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2922025-03-07T22:31:43.208ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
2932025-03-07T22:31:43.218ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:369
2942025-03-07T22:31:43.218ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool)
2952025-03-07T22:31:43.310ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }
2962025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:241
2972025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:243
2982025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
2992025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:249
3002025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3012025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3022025-03-07T22:31:43.318ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3032025-03-07T22:31:43.353ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3042025-03-07T22:31:43.361ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/zone file = sled-storage/src/dataset.rs:304
3052025-03-07T22:31:43.502ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07 file = sled-storage/src/dataset.rs:390
3062025-03-07T22:31:43.510ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3072025-03-07T22:31:43.510ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3082025-03-07T22:31:43.510ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3092025-03-07T22:31:43.510ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3102025-03-07T22:31:43.510ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3112025-03-07T22:31:43.519ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:369
3122025-03-07T22:31:43.519ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool)
3132025-03-07T22:31:43.614ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }
3142025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:241
3152025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:243
3162025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3172025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:249
3182025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3192025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3202025-03-07T22:31:43.622ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3212025-03-07T22:31:43.659ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3222025-03-07T22:31:43.667ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone file = sled-storage/src/dataset.rs:304
3232025-03-07T22:31:43.807ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f file = sled-storage/src/dataset.rs:390
3242025-03-07T22:31:43.815ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3252025-03-07T22:31:43.815ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3262025-03-07T22:31:43.815ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3272025-03-07T22:31:43.815ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3282025-03-07T22:31:43.815ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3292025-03-07T22:31:43.825ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:369
3302025-03-07T22:31:43.825ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool)
3312025-03-07T22:31:43.927ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }
3322025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:241
3332025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:243
3342025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3352025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:249
3362025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3372025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3382025-03-07T22:31:43.936ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3392025-03-07T22:31:43.973ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3402025-03-07T22:31:43.981ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone file = sled-storage/src/dataset.rs:304
3412025-03-07T22:31:44.119ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 file = sled-storage/src/dataset.rs:390
3422025-03-07T22:31:44.124ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
3432025-03-07T22:31:44.127ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3442025-03-07T22:31:44.127ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3452025-03-07T22:31:44.127ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3462025-03-07T22:31:44.127ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3472025-03-07T22:31:44.127ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3482025-03-07T22:31:44.136ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:369
3492025-03-07T22:31:44.136ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool)
3502025-03-07T22:31:44.232ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }
3512025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:241
3522025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:243
3532025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3542025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:249
3552025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3562025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3572025-03-07T22:31:44.240ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3582025-03-07T22:31:44.276ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3592025-03-07T22:31:44.284ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone file = sled-storage/src/dataset.rs:304
3602025-03-07T22:31:44.427ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550 file = sled-storage/src/dataset.rs:390
3612025-03-07T22:31:44.435ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3622025-03-07T22:31:44.435ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3632025-03-07T22:31:44.435ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3642025-03-07T22:31:44.435ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3652025-03-07T22:31:44.435ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3662025-03-07T22:31:44.445ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:369
3672025-03-07T22:31:44.445ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool)
3682025-03-07T22:31:44.540ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }
3692025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:241
3702025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:243
3712025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3722025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:249
3732025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3742025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3752025-03-07T22:31:44.548ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3762025-03-07T22:31:44.584ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3772025-03-07T22:31:44.593ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone file = sled-storage/src/dataset.rs:304
3782025-03-07T22:31:44.733ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6 file = sled-storage/src/dataset.rs:390
3792025-03-07T22:31:44.742ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3802025-03-07T22:31:44.742ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3812025-03-07T22:31:44.742ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3822025-03-07T22:31:44.742ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3832025-03-07T22:31:44.742ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3842025-03-07T22:31:44.752ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:369
3852025-03-07T22:31:44.752ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool)
3862025-03-07T22:31:44.847ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }
3872025-03-07T22:31:44.856ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:241
3882025-03-07T22:31:44.856ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:243
3892025-03-07T22:31:44.856ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3902025-03-07T22:31:44.856ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:249
3912025-03-07T22:31:44.856ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3922025-03-07T22:31:44.857ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3932025-03-07T22:31:44.857ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
3942025-03-07T22:31:44.893ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3952025-03-07T22:31:44.901ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/zone file = sled-storage/src/dataset.rs:304
3962025-03-07T22:31:45.038ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443 file = sled-storage/src/dataset.rs:390
3972025-03-07T22:31:45.046ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
3982025-03-07T22:31:45.046ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
3992025-03-07T22:31:45.046ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4002025-03-07T22:31:45.046ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4012025-03-07T22:31:45.046ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4022025-03-07T22:31:45.056ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:369
4032025-03-07T22:31:45.056ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:375 id = a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool)
4042025-03-07T22:31:45.164ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:198 zpool = ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }
4052025-03-07T22:31:45.173ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:241
4062025-03-07T22:31:45.173ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:243
4072025-03-07T22:31:45.173ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4082025-03-07T22:31:45.173ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:249
4092025-03-07T22:31:45.174ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4102025-03-07T22:31:45.174ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4112025-03-07T22:31:45.174ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:261
4122025-03-07T22:31:45.178ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4132025-03-07T22:31:45.213ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4142025-03-07T22:31:45.223ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone file = sled-storage/src/dataset.rs:304
4152025-03-07T22:31:45.367ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a392d7b0-50bb-4de9-a232-eebb50118c53 file = sled-storage/src/dataset.rs:390
4162025-03-07T22:31:45.375ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4172025-03-07T22:31:45.375ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4182025-03-07T22:31:45.375ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4192025-03-07T22:31:45.375ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66abaaaf-daa5-4de4-bd67-09c153a40921 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9e4c4ae4-c3be-41ae-b347-c365c790c0ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4202025-03-07T22:31:45.375ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:588
4212025-03-07T22:31:45.375ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
4222025-03-07T22:31:45.375ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:197 request = omicron_physical_disks_ensure
4232025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4242025-03-07T22:31:45.375ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4252025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(2) sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4262025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4272025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4282025-03-07T22:31:45.375ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:123 gen = Generation(2) sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4292025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4302025-03-07T22:31:45.375ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4312025-03-07T22:31:45.375ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4322025-03-07T22:31:45.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2770791 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44057 req_id = ff248300-788a-4f61-9b33-35c162366e7e response_code = 200 uri = /omicron-physical-disks
4332025-03-07T22:31:45.407ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {02d86121-c567-4f41-a707-63a73ab13662 (dataset): DatasetConfig { id: 02d86121-c567-4f41-a707-63a73ab13662 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07ff0b88-575c-4577-9a93-63ffb573b5b1 (dataset): DatasetConfig { id: 07ff0b88-575c-4577-9a93-63ffb573b5b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e81255c-13e6-488a-ae9b-8ef4889ccb86 (dataset): DatasetConfig { id: 0e81255c-13e6-488a-ae9b-8ef4889ccb86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15e908f4-6ee9-42dc-a3cf-f65a5ab3697d (dataset): DatasetConfig { id: 15e908f4-6ee9-42dc-a3cf-f65a5ab3697d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ca2f749-3374-4fc6-9a2a-72ece91c4cd5 (dataset): DatasetConfig { id: 2ca2f749-3374-4fc6-9a2a-72ece91c4cd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30b80c91-4bd1-46f4-83ba-fd8e9725ce65 (dataset): DatasetConfig { id: 30b80c91-4bd1-46f4-83ba-fd8e9725ce65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32678bb1-8071-42da-869c-3289a0e214c5 (dataset): DatasetConfig { id: 32678bb1-8071-42da-869c-3289a0e214c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34335c88-1106-4bf1-ae03-6c35c4581548 (dataset): DatasetConfig { id: 34335c88-1106-4bf1-ae03-6c35c4581548 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a6725b4-f274-4569-867f-eae9bfb5d143 (dataset): DatasetConfig { id: 3a6725b4-f274-4569-867f-eae9bfb5d143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e7aa718-c042-4c31-bfb4-b12e86910078 (dataset): DatasetConfig { id: 3e7aa718-c042-4c31-bfb4-b12e86910078 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f9d9638-7eb6-4ac1-8a78-6c49e2713b46 (dataset): DatasetConfig { id: 3f9d9638-7eb6-4ac1-8a78-6c49e2713b46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 409355f6-1e32-461a-92f5-5723eb9bd64e (dataset): DatasetConfig { id: 409355f6-1e32-461a-92f5-5723eb9bd64e (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e91dc0d-0c26-4a02-9f15-aaee9825d803 (dataset): DatasetConfig { id: 4e91dc0d-0c26-4a02-9f15-aaee9825d803 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52d88921-e1c0-4b06-9f69-44488d6dcade (dataset): DatasetConfig { id: 52d88921-e1c0-4b06-9f69-44488d6dcade (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 547da8c6-05cf-4e3a-9cea-e0c1aecc22d7 (dataset): DatasetConfig { id: 547da8c6-05cf-4e3a-9cea-e0c1aecc22d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b8eb9be-fd54-4b9e-b932-614c85659aea (dataset): DatasetConfig { id: 5b8eb9be-fd54-4b9e-b932-614c85659aea (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d3077f4-b540-4b14-812b-9e7f43bb1a83 (dataset): DatasetConfig { id: 5d3077f4-b540-4b14-812b-9e7f43bb1a83 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5db83431-4f62-4ede-9a45-adacbb6da55b (dataset): DatasetConfig { id: 5db83431-4f62-4ede-9a45-adacbb6da55b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6303dc03-35d5-47b8-a3c1-4108d7c6a570 (dataset): DatasetConfig { id: 6303dc03-35d5-47b8-a3c1-4108d7c6a570 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 633c5e20-6ee3-47a8-84a5-3ba3a27c3905 (dataset): DatasetConfig { id: 633c5e20-6ee3-47a8-84a5-3ba3a27c3905 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69867327-e337-4c58-9d0c-1792f695d9ef (dataset): DatasetConfig { id: 69867327-e337-4c58-9d0c-1792f695d9ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69ec46e1-e9b2-4376-89a4-25474c317481 (dataset): DatasetConfig { id: 69ec46e1-e9b2-4376-89a4-25474c317481 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ec186a5-f7f3-444d-9387-c1e6d7885cf8 (dataset): DatasetConfig { id: 6ec186a5-f7f3-444d-9387-c1e6d7885cf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f19ce32-4493-4282-8481-a4b954e171b3 (dataset): DatasetConfig { id: 6f19ce32-4493-4282-8481-a4b954e171b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6f2ae48b-2a2a-45a8-ba9a-7ac6361e47a4 (dataset): DatasetConfig { id: 6f2ae48b-2a2a-45a8-ba9a-7ac6361e47a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70daab02-7688-4e27-9414-0757d782612d (dataset): DatasetConfig { id: 70daab02-7688-4e27-9414-0757d782612d (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f501f9-f22b-4f1a-b420-44bb93bbf297 (dataset): DatasetConfig { id: 71f501f9-f22b-4f1a-b420-44bb93bbf297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 735ba95d-0cef-40f2-ad70-2eafd85a5531 (dataset): DatasetConfig { id: 735ba95d-0cef-40f2-ad70-2eafd85a5531 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 757e3234-f170-462e-9cb8-330ca925c5a6 (dataset): DatasetConfig { id: 757e3234-f170-462e-9cb8-330ca925c5a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 75d5799c-643e-4849-a3fb-379ea196b7b1 (dataset): DatasetConfig { id: 75d5799c-643e-4849-a3fb-379ea196b7b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a03ce60-bf12-4483-b6b7-7447f3f55850 (dataset): DatasetConfig { id: 8a03ce60-bf12-4483-b6b7-7447f3f55850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b1e6eb2-e698-4142-9bea-a18d55c3cce7 (dataset): DatasetConfig { id: 8b1e6eb2-e698-4142-9bea-a18d55c3cce7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dbb70b0-fecf-4fd9-b84b-496ef65c263a (dataset): DatasetConfig { id: 8dbb70b0-fecf-4fd9-b84b-496ef65c263a (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f47b6b8-7530-4087-b95f-1f3ab1786341 (dataset): DatasetConfig { id: 8f47b6b8-7530-4087-b95f-1f3ab1786341 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 959cc57d-8e34-4d09-a0d5-c7dcfc46eb08 (dataset): DatasetConfig { id: 959cc57d-8e34-4d09-a0d5-c7dcfc46eb08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c6b6e14-fb2c-49ba-8f39-454eddcc97c4 (dataset): DatasetConfig { id: 9c6b6e14-fb2c-49ba-8f39-454eddcc97c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0b1e1ac-b1af-48a4-a0ad-1993fab66392 (dataset): DatasetConfig { id: a0b1e1ac-b1af-48a4-a0ad-1993fab66392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0defb5f-178c-434a-a0e3-893e06cd4e7a (dataset): DatasetConfig { id: a0defb5f-178c-434a-a0e3-893e06cd4e7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a33d4d71-5f96-4664-8118-dfc741d88406 (dataset): DatasetConfig { id: a33d4d71-5f96-4664-8118-dfc741d88406 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a45878ce-91ea-4cf9-8720-89809c6168bb (dataset): DatasetConfig { id: a45878ce-91ea-4cf9-8720-89809c6168bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a47f3022-ac89-4dbe-8ae6-97f298dfb502 (dataset): DatasetConfig { id: a47f3022-ac89-4dbe-8ae6-97f298dfb502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6730a63-6f25-4f9f-9fc1-0f27592cc3b7 (dataset): DatasetConfig { id: a6730a63-6f25-4f9f-9fc1-0f27592cc3b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9e5b4d7-256d-4590-b0f6-22ef6cf43fbd (dataset): DatasetConfig { id: a9e5b4d7-256d-4590-b0f6-22ef6cf43fbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab70b10d-d139-4845-8a6e-304cd1449200 (dataset): DatasetConfig { id: ab70b10d-d139-4845-8a6e-304cd1449200 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3db84d5-5dcd-4217-82cd-955d387a3a95 (dataset): DatasetConfig { id: b3db84d5-5dcd-4217-82cd-955d387a3a95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bef24eab-eacc-4549-b559-c3c7043f923a (dataset): DatasetConfig { id: bef24eab-eacc-4549-b559-c3c7043f923a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfbe2d2e-966f-4566-8deb-27c96901c6f7 (dataset): DatasetConfig { id: bfbe2d2e-966f-4566-8deb-27c96901c6f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c065492d-73ea-4f39-b478-205656e4eccc (dataset): DatasetConfig { id: c065492d-73ea-4f39-b478-205656e4eccc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4d93e35-13a3-4b57-8828-969d7083ddac (dataset): DatasetConfig { id: c4d93e35-13a3-4b57-8828-969d7083ddac (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0eeb1bc-40af-4085-a0e8-d2da0ae6e231 (dataset): DatasetConfig { id: d0eeb1bc-40af-4085-a0e8-d2da0ae6e231 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d104ab9a-58bb-4c2b-975f-7239ad948187 (dataset): DatasetConfig { id: d104ab9a-58bb-4c2b-975f-7239ad948187 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc13ec34-8550-4835-b052-dd665f0eeda9 (dataset): DatasetConfig { id: dc13ec34-8550-4835-b052-dd665f0eeda9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcb7ebf6-017f-4a02-9289-83d9f2edf869 (dataset): DatasetConfig { id: dcb7ebf6-017f-4a02-9289-83d9f2edf869 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfa710a1-27de-4a78-bda1-4bdfc8b6a629 (dataset): DatasetConfig { id: dfa710a1-27de-4a78-bda1-4bdfc8b6a629 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfd2cd79-3474-4fb2-9852-3ff67cbe8b1a (dataset): DatasetConfig { id: dfd2cd79-3474-4fb2-9852-3ff67cbe8b1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0c139fc-a086-410d-9a76-56a42f74eb10 (dataset): DatasetConfig { id: e0c139fc-a086-410d-9a76-56a42f74eb10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4687bfc-d270-4845-adc8-07be6312ce3d (dataset): DatasetConfig { id: e4687bfc-d270-4845-adc8-07be6312ce3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7853b32-a31c-4e47-b57b-b35d1306107d (dataset): DatasetConfig { id: e7853b32-a31c-4e47-b57b-b35d1306107d (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e9a2e80d-f014-4a27-9870-e51ed86df920 (dataset): DatasetConfig { id: e9a2e80d-f014-4a27-9870-e51ed86df920 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f001a1fa-8f7c-4264-9a46-9d4e570d5e09 (dataset): DatasetConfig { id: f001a1fa-8f7c-4264-9a46-9d4e570d5e09 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f02ae485-831f-45a6-a81c-e5ba6634f3f4 (dataset): DatasetConfig { id: f02ae485-831f-45a6-a81c-e5ba6634f3f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f148717d-fec4-4621-9bd9-98338ad4274e (dataset): DatasetConfig { id: f148717d-fec4-4621-9bd9-98338ad4274e (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f14fcf64-4fbc-495d-abad-e014a913ce00 (dataset): DatasetConfig { id: f14fcf64-4fbc-495d-abad-e014a913ce00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3f4078c-79a4-4d05-82f4-dc26036503ae (dataset): DatasetConfig { id: f3f4078c-79a4-4d05-82f4-dc26036503ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd175452-dd2d-4554-a2df-f6b436225640 (dataset): DatasetConfig { id: fd175452-dd2d-4554-a2df-f6b436225640 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fda95cd8-26b2-468e-a8de-e58ccbc80676 (dataset): DatasetConfig { id: fda95cd8-26b2-468e-a8de-e58ccbc80676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:527 sled_address = [fd00:1122:3344:101::1]:12345
4342025-03-07T22:31:45.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62582
4352025-03-07T22:31:45.408ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4362025-03-07T22:31:45.408ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {02d86121-c567-4f41-a707-63a73ab13662 (dataset): DatasetConfig { id: 02d86121-c567-4f41-a707-63a73ab13662 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07ff0b88-575c-4577-9a93-63ffb573b5b1 (dataset): DatasetConfig { id: 07ff0b88-575c-4577-9a93-63ffb573b5b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e81255c-13e6-488a-ae9b-8ef4889ccb86 (dataset): DatasetConfig { id: 0e81255c-13e6-488a-ae9b-8ef4889ccb86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15e908f4-6ee9-42dc-a3cf-f65a5ab3697d (dataset): DatasetConfig { id: 15e908f4-6ee9-42dc-a3cf-f65a5ab3697d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ca2f749-3374-4fc6-9a2a-72ece91c4cd5 (dataset): DatasetConfig { id: 2ca2f749-3374-4fc6-9a2a-72ece91c4cd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30b80c91-4bd1-46f4-83ba-fd8e9725ce65 (dataset): DatasetConfig { id: 30b80c91-4bd1-46f4-83ba-fd8e9725ce65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32678bb1-8071-42da-869c-3289a0e214c5 (dataset): DatasetConfig { id: 32678bb1-8071-42da-869c-3289a0e214c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34335c88-1106-4bf1-ae03-6c35c4581548 (dataset): DatasetConfig { id: 34335c88-1106-4bf1-ae03-6c35c4581548 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a6725b4-f274-4569-867f-eae9bfb5d143 (dataset): DatasetConfig { id: 3a6725b4-f274-4569-867f-eae9bfb5d143 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e7aa718-c042-4c31-bfb4-b12e86910078 (dataset): DatasetConfig { id: 3e7aa718-c042-4c31-bfb4-b12e86910078 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3f9d9638-7eb6-4ac1-8a78-6c49e2713b46 (dataset): DatasetConfig { id: 3f9d9638-7eb6-4ac1-8a78-6c49e2713b46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 409355f6-1e32-461a-92f5-5723eb9bd64e (dataset): DatasetConfig { id: 409355f6-1e32-461a-92f5-5723eb9bd64e (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e91dc0d-0c26-4a02-9f15-aaee9825d803 (dataset): DatasetConfig { id: 4e91dc0d-0c26-4a02-9f15-aaee9825d803 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52d88921-e1c0-4b06-9f69-44488d6dcade (dataset): DatasetConfig { id: 52d88921-e1c0-4b06-9f69-44488d6dcade (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 547da8c6-05cf-4e3a-9cea-e0c1aecc22d7 (dataset): DatasetConfig { id: 547da8c6-05cf-4e3a-9cea-e0c1aecc22d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b8eb9be-fd54-4b9e-b932-614c85659aea (dataset): DatasetConfig { id: 5b8eb9be-fd54-4b9e-b932-614c85659aea (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d3077f4-b540-4b14-812b-9e7f43bb1a83 (dataset): DatasetConfig { id: 5d3077f4-b540-4b14-812b-9e7f43bb1a83 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5db83431-4f62-4ede-9a45-adacbb6da55b (dataset): DatasetConfig { id: 5db83431-4f62-4ede-9a45-adacbb6da55b (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6303dc03-35d5-47b8-a3c1-4108d7c6a570 (dataset): DatasetConfig { id: 6303dc03-35d5-47b8-a3c1-4108d7c6a570 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 633c5e20-6ee3-47a8-84a5-3ba3a27c3905 (dataset): DatasetConfig { id: 633c5e20-6ee3-47a8-84a5-3ba3a27c3905 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69867327-e337-4c58-9d0c-1792f695d9ef (dataset): DatasetConfig { id: 69867327-e337-4c58-9d0c-1792f695d9ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 69ec46e1-e9b2-4376-89a4-25474c317481 (dataset): DatasetConfig { id: 69ec46e1-e9b2-4376-89a4-25474c317481 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ec186a5-f7f3-444d-9387-c1e6d7885cf8 (dataset): DatasetConfig { id: 6ec186a5-f7f3-444d-9387-c1e6d7885cf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f19ce32-4493-4282-8481-a4b954e171b3 (dataset): DatasetConfig { id: 6f19ce32-4493-4282-8481-a4b954e171b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6f2ae48b-2a2a-45a8-ba9a-7ac6361e47a4 (dataset): DatasetConfig { id: 6f2ae48b-2a2a-45a8-ba9a-7ac6361e47a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70daab02-7688-4e27-9414-0757d782612d (dataset): DatasetConfig { id: 70daab02-7688-4e27-9414-0757d782612d (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f501f9-f22b-4f1a-b420-44bb93bbf297 (dataset): DatasetConfig { id: 71f501f9-f22b-4f1a-b420-44bb93bbf297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 735ba95d-0cef-40f2-ad70-2eafd85a5531 (dataset): DatasetConfig { id: 735ba95d-0cef-40f2-ad70-2eafd85a5531 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 757e3234-f170-462e-9cb8-330ca925c5a6 (dataset): DatasetConfig { id: 757e3234-f170-462e-9cb8-330ca925c5a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 75d5799c-643e-4849-a3fb-379ea196b7b1 (dataset): DatasetConfig { id: 75d5799c-643e-4849-a3fb-379ea196b7b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a03ce60-bf12-4483-b6b7-7447f3f55850 (dataset): DatasetConfig { id: 8a03ce60-bf12-4483-b6b7-7447f3f55850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b1e6eb2-e698-4142-9bea-a18d55c3cce7 (dataset): DatasetConfig { id: 8b1e6eb2-e698-4142-9bea-a18d55c3cce7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dbb70b0-fecf-4fd9-b84b-496ef65c263a (dataset): DatasetConfig { id: 8dbb70b0-fecf-4fd9-b84b-496ef65c263a (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f47b6b8-7530-4087-b95f-1f3ab1786341 (dataset): DatasetConfig { id: 8f47b6b8-7530-4087-b95f-1f3ab1786341 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 959cc57d-8e34-4d09-a0d5-c7dcfc46eb08 (dataset): DatasetConfig { id: 959cc57d-8e34-4d09-a0d5-c7dcfc46eb08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c6b6e14-fb2c-49ba-8f39-454eddcc97c4 (dataset): DatasetConfig { id: 9c6b6e14-fb2c-49ba-8f39-454eddcc97c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0b1e1ac-b1af-48a4-a0ad-1993fab66392 (dataset): DatasetConfig { id: a0b1e1ac-b1af-48a4-a0ad-1993fab66392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0defb5f-178c-434a-a0e3-893e06cd4e7a (dataset): DatasetConfig { id: a0defb5f-178c-434a-a0e3-893e06cd4e7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a33d4d71-5f96-4664-8118-dfc741d88406 (dataset): DatasetConfig { id: a33d4d71-5f96-4664-8118-dfc741d88406 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a45878ce-91ea-4cf9-8720-89809c6168bb (dataset): DatasetConfig { id: a45878ce-91ea-4cf9-8720-89809c6168bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a47f3022-ac89-4dbe-8ae6-97f298dfb502 (dataset): DatasetConfig { id: a47f3022-ac89-4dbe-8ae6-97f298dfb502 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6730a63-6f25-4f9f-9fc1-0f27592cc3b7 (dataset): DatasetConfig { id: a6730a63-6f25-4f9f-9fc1-0f27592cc3b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9e5b4d7-256d-4590-b0f6-22ef6cf43fbd (dataset): DatasetConfig { id: a9e5b4d7-256d-4590-b0f6-22ef6cf43fbd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab70b10d-d139-4845-8a6e-304cd1449200 (dataset): DatasetConfig { id: ab70b10d-d139-4845-8a6e-304cd1449200 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3db84d5-5dcd-4217-82cd-955d387a3a95 (dataset): DatasetConfig { id: b3db84d5-5dcd-4217-82cd-955d387a3a95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bef24eab-eacc-4549-b559-c3c7043f923a (dataset): DatasetConfig { id: bef24eab-eacc-4549-b559-c3c7043f923a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfbe2d2e-966f-4566-8deb-27c96901c6f7 (dataset): DatasetConfig { id: bfbe2d2e-966f-4566-8deb-27c96901c6f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c065492d-73ea-4f39-b478-205656e4eccc (dataset): DatasetConfig { id: c065492d-73ea-4f39-b478-205656e4eccc (dataset), name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4d93e35-13a3-4b57-8828-969d7083ddac (dataset): DatasetConfig { id: c4d93e35-13a3-4b57-8828-969d7083ddac (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0eeb1bc-40af-4085-a0e8-d2da0ae6e231 (dataset): DatasetConfig { id: d0eeb1bc-40af-4085-a0e8-d2da0ae6e231 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d104ab9a-58bb-4c2b-975f-7239ad948187 (dataset): DatasetConfig { id: d104ab9a-58bb-4c2b-975f-7239ad948187 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc13ec34-8550-4835-b052-dd665f0eeda9 (dataset): DatasetConfig { id: dc13ec34-8550-4835-b052-dd665f0eeda9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcb7ebf6-017f-4a02-9289-83d9f2edf869 (dataset): DatasetConfig { id: dcb7ebf6-017f-4a02-9289-83d9f2edf869 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfa710a1-27de-4a78-bda1-4bdfc8b6a629 (dataset): DatasetConfig { id: dfa710a1-27de-4a78-bda1-4bdfc8b6a629 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfd2cd79-3474-4fb2-9852-3ff67cbe8b1a (dataset): DatasetConfig { id: dfd2cd79-3474-4fb2-9852-3ff67cbe8b1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0c139fc-a086-410d-9a76-56a42f74eb10 (dataset): DatasetConfig { id: e0c139fc-a086-410d-9a76-56a42f74eb10 (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4687bfc-d270-4845-adc8-07be6312ce3d (dataset): DatasetConfig { id: e4687bfc-d270-4845-adc8-07be6312ce3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7853b32-a31c-4e47-b57b-b35d1306107d (dataset): DatasetConfig { id: e7853b32-a31c-4e47-b57b-b35d1306107d (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e9a2e80d-f014-4a27-9870-e51ed86df920 (dataset): DatasetConfig { id: e9a2e80d-f014-4a27-9870-e51ed86df920 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f001a1fa-8f7c-4264-9a46-9d4e570d5e09 (dataset): DatasetConfig { id: f001a1fa-8f7c-4264-9a46-9d4e570d5e09 (dataset), name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f02ae485-831f-45a6-a81c-e5ba6634f3f4 (dataset): DatasetConfig { id: f02ae485-831f-45a6-a81c-e5ba6634f3f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f148717d-fec4-4621-9bd9-98338ad4274e (dataset): DatasetConfig { id: f148717d-fec4-4621-9bd9-98338ad4274e (dataset), name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f14fcf64-4fbc-495d-abad-e014a913ce00 (dataset): DatasetConfig { id: f14fcf64-4fbc-495d-abad-e014a913ce00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3f4078c-79a4-4d05-82f4-dc26036503ae (dataset): DatasetConfig { id: f3f4078c-79a4-4d05-82f4-dc26036503ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd175452-dd2d-4554-a2df-f6b436225640 (dataset): DatasetConfig { id: fd175452-dd2d-4554-a2df-f6b436225640 (dataset), name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fda95cd8-26b2-468e-a8de-e58ccbc80676 (dataset): DatasetConfig { id: fda95cd8-26b2-468e-a8de-e58ccbc80676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4372025-03-07T22:31:45.408ZINFOSledAgent (StorageManager): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4382025-03-07T22:31:45.408ZINFOSledAgent (StorageManager): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-datasets.json file = common/src/ledger.rs:186 request = datasets_ensure
4392025-03-07T22:31:45.408ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4402025-03-07T22:31:45.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4412025-03-07T22:31:45.424ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4422025-03-07T22:31:45.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crucible" } file = sled-storage/src/manager.rs:1433
4432025-03-07T22:31:45.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4442025-03-07T22:31:45.476ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4452025-03-07T22:31:45.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4" } file = sled-storage/src/manager.rs:1433
4462025-03-07T22:31:45.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4472025-03-07T22:31:45.536ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4482025-03-07T22:31:45.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
4492025-03-07T22:31:45.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4502025-03-07T22:31:45.585ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4512025-03-07T22:31:45.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crucible" } file = sled-storage/src/manager.rs:1433
4522025-03-07T22:31:45.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4532025-03-07T22:31:45.634ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4542025-03-07T22:31:45.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crucible" } file = sled-storage/src/manager.rs:1433
4552025-03-07T22:31:45.682ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4562025-03-07T22:31:45.682ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4572025-03-07T22:31:45.682ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
4582025-03-07T22:31:45.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4592025-03-07T22:31:45.734ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4602025-03-07T22:31:45.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2" } file = sled-storage/src/manager.rs:1433
4612025-03-07T22:31:45.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4622025-03-07T22:31:45.795ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4632025-03-07T22:31:45.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/zone/oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930"), full_name: "oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/zone/oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930" } file = sled-storage/src/manager.rs:1433
4642025-03-07T22:31:45.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4652025-03-07T22:31:45.853ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4662025-03-07T22:31:45.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone" } file = sled-storage/src/manager.rs:1433
4672025-03-07T22:31:45.882ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4682025-03-07T22:31:45.882ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4692025-03-07T22:31:45.882ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/debug"), full_name: "oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/debug" } file = sled-storage/src/manager.rs:1433
4702025-03-07T22:31:45.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4712025-03-07T22:31:45.912ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4722025-03-07T22:31:45.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3" } file = sled-storage/src/manager.rs:1433
4732025-03-07T22:31:45.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4742025-03-07T22:31:45.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4752025-03-07T22:31:45.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b" } file = sled-storage/src/manager.rs:1433
4762025-03-07T22:31:46.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4772025-03-07T22:31:46.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4782025-03-07T22:31:46.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a" } file = sled-storage/src/manager.rs:1433
4792025-03-07T22:31:46.092ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4802025-03-07T22:31:46.092ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4812025-03-07T22:31:46.092ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776" } file = sled-storage/src/manager.rs:1433
4822025-03-07T22:31:46.154ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4832025-03-07T22:31:46.154ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4842025-03-07T22:31:46.154ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/debug"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/debug" } file = sled-storage/src/manager.rs:1433
4852025-03-07T22:31:46.180ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
4862025-03-07T22:31:46.183ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4872025-03-07T22:31:46.183ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4882025-03-07T22:31:46.183ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a" } file = sled-storage/src/manager.rs:1433
4892025-03-07T22:31:46.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4902025-03-07T22:31:46.243ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4912025-03-07T22:31:46.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/debug"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/debug" } file = sled-storage/src/manager.rs:1433
4922025-03-07T22:31:46.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4932025-03-07T22:31:46.273ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
4942025-03-07T22:31:46.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
4952025-03-07T22:31:46.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4962025-03-07T22:31:46.322ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
4972025-03-07T22:31:46.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/debug"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/debug" } file = sled-storage/src/manager.rs:1433
4982025-03-07T22:31:46.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
4992025-03-07T22:31:46.352ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5002025-03-07T22:31:46.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8" } file = sled-storage/src/manager.rs:1433
5012025-03-07T22:31:46.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5022025-03-07T22:31:46.414ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5032025-03-07T22:31:46.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/debug"), full_name: "oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/debug" } file = sled-storage/src/manager.rs:1433
5042025-03-07T22:31:46.442ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5052025-03-07T22:31:46.442ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5062025-03-07T22:31:46.442ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/zone"), full_name: "oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/zone" } file = sled-storage/src/manager.rs:1433
5072025-03-07T22:31:46.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5082025-03-07T22:31:46.472ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5092025-03-07T22:31:46.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd" } file = sled-storage/src/manager.rs:1433
5102025-03-07T22:31:46.533ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5112025-03-07T22:31:46.533ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5122025-03-07T22:31:46.533ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/debug"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/debug" } file = sled-storage/src/manager.rs:1433
5132025-03-07T22:31:46.562ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5142025-03-07T22:31:46.562ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5152025-03-07T22:31:46.562ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone" } file = sled-storage/src/manager.rs:1433
5162025-03-07T22:31:46.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5172025-03-07T22:31:46.592ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5182025-03-07T22:31:46.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383" } file = sled-storage/src/manager.rs:1433
5192025-03-07T22:31:46.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5202025-03-07T22:31:46.653ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5212025-03-07T22:31:46.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee" } file = sled-storage/src/manager.rs:1433
5222025-03-07T22:31:46.713ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5232025-03-07T22:31:46.713ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5242025-03-07T22:31:46.713ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crucible" } file = sled-storage/src/manager.rs:1433
5252025-03-07T22:31:46.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5262025-03-07T22:31:46.763ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5272025-03-07T22:31:46.763ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/debug"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/debug" } file = sled-storage/src/manager.rs:1433
5282025-03-07T22:31:46.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5292025-03-07T22:31:46.792ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5302025-03-07T22:31:46.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff" } file = sled-storage/src/manager.rs:1433
5312025-03-07T22:31:46.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5322025-03-07T22:31:46.853ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5332025-03-07T22:31:46.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9" } file = sled-storage/src/manager.rs:1433
5342025-03-07T22:31:46.916ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5352025-03-07T22:31:46.916ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5362025-03-07T22:31:46.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/zone"), full_name: "oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/zone" } file = sled-storage/src/manager.rs:1433
5372025-03-07T22:31:46.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5382025-03-07T22:31:46.944ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5392025-03-07T22:31:46.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone" } file = sled-storage/src/manager.rs:1433
5402025-03-07T22:31:46.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5412025-03-07T22:31:46.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5422025-03-07T22:31:46.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/zone/oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128" } file = sled-storage/src/manager.rs:1433
5432025-03-07T22:31:47.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5442025-03-07T22:31:47.034ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5452025-03-07T22:31:47.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone" } file = sled-storage/src/manager.rs:1433
5462025-03-07T22:31:47.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5472025-03-07T22:31:47.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5482025-03-07T22:31:47.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5492025-03-07T22:31:47.113ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5502025-03-07T22:31:47.113ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5512025-03-07T22:31:47.113ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a" } file = sled-storage/src/manager.rs:1433
5522025-03-07T22:31:47.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5532025-03-07T22:31:47.174ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5542025-03-07T22:31:47.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone" } file = sled-storage/src/manager.rs:1433
5552025-03-07T22:31:47.182ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
5562025-03-07T22:31:47.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5572025-03-07T22:31:47.204ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5582025-03-07T22:31:47.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
5592025-03-07T22:31:47.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5602025-03-07T22:31:47.254ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5612025-03-07T22:31:47.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/clickhouse" } file = sled-storage/src/manager.rs:1433
5622025-03-07T22:31:47.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5632025-03-07T22:31:47.304ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5642025-03-07T22:31:47.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0" } file = sled-storage/src/manager.rs:1433
5652025-03-07T22:31:47.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5662025-03-07T22:31:47.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5672025-03-07T22:31:47.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8" } file = sled-storage/src/manager.rs:1433
5682025-03-07T22:31:47.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5692025-03-07T22:31:47.428ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5702025-03-07T22:31:47.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618" } file = sled-storage/src/manager.rs:1433
5712025-03-07T22:31:47.488ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5722025-03-07T22:31:47.488ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5732025-03-07T22:31:47.488ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
5742025-03-07T22:31:47.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5752025-03-07T22:31:47.539ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5762025-03-07T22:31:47.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f"), full_name: "oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/zone/oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f" } file = sled-storage/src/manager.rs:1433
5772025-03-07T22:31:47.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5782025-03-07T22:31:47.604ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5792025-03-07T22:31:47.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80" } file = sled-storage/src/manager.rs:1433
5802025-03-07T22:31:47.666ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5812025-03-07T22:31:47.666ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
5822025-03-07T22:31:47.666ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone" } file = sled-storage/src/manager.rs:1433
5832025-03-07T22:31:47.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5842025-03-07T22:31:47.695ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5852025-03-07T22:31:47.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c"), full_name: "oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/zone/oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c" } file = sled-storage/src/manager.rs:1433
5862025-03-07T22:31:47.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5872025-03-07T22:31:47.756ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5882025-03-07T22:31:47.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone/oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886" } file = sled-storage/src/manager.rs:1433
5892025-03-07T22:31:47.785ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.676106136s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
5902025-03-07T22:31:47.819ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5912025-03-07T22:31:47.819ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5922025-03-07T22:31:47.819ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/zone/oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a"), full_name: "oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/zone/oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a" } file = sled-storage/src/manager.rs:1433
5932025-03-07T22:31:47.880ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5942025-03-07T22:31:47.880ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5952025-03-07T22:31:47.880ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/external_dns" } file = sled-storage/src/manager.rs:1433
5962025-03-07T22:31:47.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
5972025-03-07T22:31:47.930ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
5982025-03-07T22:31:47.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25" } file = sled-storage/src/manager.rs:1433
5992025-03-07T22:31:47.993ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6002025-03-07T22:31:47.993ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6012025-03-07T22:31:47.993ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crucible" } file = sled-storage/src/manager.rs:1433
6022025-03-07T22:31:48.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6032025-03-07T22:31:48.045ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6042025-03-07T22:31:48.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/zone/oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9" } file = sled-storage/src/manager.rs:1433
6052025-03-07T22:31:48.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6062025-03-07T22:31:48.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6072025-03-07T22:31:48.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crucible" } file = sled-storage/src/manager.rs:1433
6082025-03-07T22:31:48.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6092025-03-07T22:31:48.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6102025-03-07T22:31:48.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crucible" } file = sled-storage/src/manager.rs:1433
6112025-03-07T22:31:48.184ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
6122025-03-07T22:31:48.207ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6132025-03-07T22:31:48.207ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6142025-03-07T22:31:48.207ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/debug"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/debug" } file = sled-storage/src/manager.rs:1433
6152025-03-07T22:31:48.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6162025-03-07T22:31:48.247ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6172025-03-07T22:31:48.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/debug"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/debug" } file = sled-storage/src/manager.rs:1433
6182025-03-07T22:31:48.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6192025-03-07T22:31:48.277ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6202025-03-07T22:31:48.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1433
6212025-03-07T22:31:48.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6222025-03-07T22:31:48.327ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6232025-03-07T22:31:48.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6242025-03-07T22:31:48.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6252025-03-07T22:31:48.378ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6262025-03-07T22:31:48.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crucible" } file = sled-storage/src/manager.rs:1433
6272025-03-07T22:31:48.427ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6282025-03-07T22:31:48.427ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6292025-03-07T22:31:48.427ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620"), full_name: "oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/zone/oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620" } file = sled-storage/src/manager.rs:1433
6302025-03-07T22:31:48.490ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6312025-03-07T22:31:48.490ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6322025-03-07T22:31:48.490ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563"), full_name: "oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/zone/oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563" } file = sled-storage/src/manager.rs:1433
6332025-03-07T22:31:48.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6342025-03-07T22:31:48.553ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:1001 request = datasets_ensure
6352025-03-07T22:31:48.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone"), full_name: "oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/zone" } file = sled-storage/src/manager.rs:1433
6362025-03-07T22:31:48.585ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6372025-03-07T22:31:48.585ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6382025-03-07T22:31:48.585ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crucible" } file = sled-storage/src/manager.rs:1433
6392025-03-07T22:31:48.634ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1042 request = datasets_ensure
6402025-03-07T22:31:48.634ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:996 request = datasets_ensure
6412025-03-07T22:31:48.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1433
6422025-03-07T22:31:48.687ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6432025-03-07T22:31:48.687ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:197 request = datasets_ensure
6442025-03-07T22:31:48.687ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
6452025-03-07T22:31:48.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3280213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62582 req_id = 8088429d-5d3a-480c-844b-728063dceed0 response_code = 200 uri = /datasets
6462025-03-07T22:31:48.719ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: d2f04f38-7ac2-4327-a087-c2a47865841a (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a9773e0b-15d4-4efa-b977-9f3598685cdd (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 114e494f-6e94-4e0c-80db-5823b226f1a3 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
6472025-03-07T22:31:48.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39712
6482025-03-07T22:31:48.719ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6492025-03-07T22:31:48.719ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502025-03-07T22:31:48.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6512025-03-07T22:31:48.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-03-07T22:31:48.738ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6532025-03-07T22:31:48.738ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542025-03-07T22:31:48.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6552025-03-07T22:31:48.747ZINFOSledAgent (ServiceManager): No ledger in /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:186
6562025-03-07T22:31:48.747ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:186
6572025-03-07T22:31:48.747ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 3 num_zones_to_be_removed = 0 num_zones_updated = 0
6582025-03-07T22:31:48.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6592025-03-07T22:31:48.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6602025-03-07T22:31:48.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-03-07T22:31:48.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-03-07T22:31:48.848ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd file = illumos-utils/src/zone.rs:327
6632025-03-07T22:31:48.852ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3 file = illumos-utils/src/zone.rs:327
6642025-03-07T22:31:48.857ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a file = illumos-utils/src/zone.rs:327
6652025-03-07T22:31:48.869ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd file = illumos-utils/src/zone.rs:365
6662025-03-07T22:31:48.874ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3 file = illumos-utils/src/zone.rs:365
6672025-03-07T22:31:48.878ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a file = illumos-utils/src/zone.rs:365
6682025-03-07T22:31:49.186ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/probe_manager.rs:234 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
6692025-03-07T22:31:50.633ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6702025-03-07T22:31:50.633ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
6712025-03-07T22:31:51.122ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6722025-03-07T22:31:51.604ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732025-03-07T22:31:51.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 38.836792ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
6742025-03-07T22:31:51.611ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
6752025-03-07T22:31:51.615ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
6762025-03-07T22:31:51.661ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 72.312732ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
6772025-03-07T22:31:51.685ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4367
6782025-03-07T22:31:51.685ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4377 gateway = fd00:1122:3344:101::1
6792025-03-07T22:31:51.692ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4391 gateway = fd00:1122:3344:101::1
6802025-03-07T22:31:51.692ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4456
6812025-03-07T22:31:51.745ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 116.003383ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
6822025-03-07T22:31:51.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 43.825019ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
6832025-03-07T22:31:51.760ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 54.81966ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
6842025-03-07T22:31:51.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 117.98789ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
6852025-03-07T22:31:51.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 70.08951ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
6862025-03-07T22:31:52.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7921123242625804779 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
6872025-03-07T22:31:52.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12225070216946380756 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
6882025-03-07T22:31:52.116ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 596.237446ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
6892025-03-07T22:31:52.142ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 194.838787ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
6902025-03-07T22:31:52.170ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4497
6912025-03-07T22:31:52.170ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4530
6922025-03-07T22:31:52.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 132.061783ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
6932025-03-07T22:31:52.312ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4543
6942025-03-07T22:31:52.312ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4408
6952025-03-07T22:31:52.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 241.944005ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
6962025-03-07T22:31:52.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 520.501449ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
6972025-03-07T22:31:52.432ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4450
6982025-03-07T22:31:52.432ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4507 rack_subnet = fd00:1122:3344::
6992025-03-07T22:31:52.463ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4518
7002025-03-07T22:31:52.463ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4600
7012025-03-07T22:31:52.518ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10678064581314328160 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
7022025-03-07T22:31:52.518ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13224156581830762376 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
7032025-03-07T22:31:52.549ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4632
7042025-03-07T22:31:52.549ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4638
7052025-03-07T22:31:52.574ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 679.069231ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
7062025-03-07T22:31:52.655ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4679
7072025-03-07T22:31:52.655ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4549
7082025-03-07T22:31:52.722ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 957.91587ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
7092025-03-07T22:31:52.747ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4582
7102025-03-07T22:31:52.747ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7112025-03-07T22:31:52.781ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/nexus.rs:530 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
7122025-03-07T22:31:52.782ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7132025-03-07T22:31:52.815ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7142025-03-07T22:31:52.816ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7152025-03-07T22:31:52.816ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7162025-03-07T22:31:52.816ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7172025-03-07T22:31:52.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
7182025-03-07T22:31:52.900ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 526.793762ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7192025-03-07T22:31:52.909ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7202025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7212025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7222025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7232025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7242025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7252025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7262025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7272025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7282025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7292025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7302025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7312025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7322025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7332025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7342025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7352025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7362025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7372025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7382025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7392025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7402025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7412025-03-07T22:31:52.909ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7422025-03-07T22:31:53.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 1.078061921s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
7432025-03-07T22:31:53.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 1.07834374s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7442025-03-07T22:31:53.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 1.304488193s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
7452025-03-07T22:31:54.352ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 1.393206799s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
7462025-03-07T22:31:54.527ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 1.490990529s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7472025-03-07T22:31:55.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 1.282999464s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
7482025-03-07T22:31:55.755ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a") failed: Property not found. retry in 1.013295144s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
7492025-03-07T22:31:56.029ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 697.062594ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7502025-03-07T22:31:56.297ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd") failed: Property not found. retry in 844.266225ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
7512025-03-07T22:31:56.737ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3") failed: Property not found. retry in 712.873957ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7522025-03-07T22:31:57.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_a9773e0b-15d4-4efa-b977-9f3598685cdd
7532025-03-07T22:31:57.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_114e494f-6e94-4e0c-80db-5823b226f1a3
7542025-03-07T22:31:57.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_internal_dns_d2f04f38-7ac2-4327-a087-c2a47865841a
7552025-03-07T22:31:57.471ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7562025-03-07T22:31:57.471ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
7572025-03-07T22:31:57.472ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
7582025-03-07T22:31:57.472ZINFOSledAgent (DdmReconciler): attempting to add new prefix advertisements file = sled-agent/src/ddm_reconciler.rs:240 to_advertise = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }]
7592025-03-07T22:31:57.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8752689 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39712 req_id = b4db38cb-cb4a-4d4b-99ec-cac0a371f4af response_code = 204 uri = /omicron-zones
7602025-03-07T22:31:57.472ZINFOSledAgent (DdmReconciler): completed prefix advertisement reconcilation added = [Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }] file = sled-agent/src/ddm_reconciler.rs:272 prefixes = {Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }, Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }, Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }} withdrawn = []
7612025-03-07T22:31:57.475ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7622025-03-07T22:31:57.711ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 116.383606ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:745
7632025-03-07T22:31:57.845ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7642025-03-07T22:31:57.899ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:725
7652025-03-07T22:31:57.945ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:761
7662025-03-07T22:31:57.945ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7672025-03-07T22:31:57.975ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7682025-03-07T22:31:57.976ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7692025-03-07T22:31:57.976ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7702025-03-07T22:31:58.005ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: d2f04f38-7ac2-4327-a087-c2a47865841a (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a9773e0b-15d4-4efa-b977-9f3598685cdd (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 114e494f-6e94-4e0c-80db-5823b226f1a3 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 404074d8-d4b4-4a8d-887e-08e81a4d686e, kind: Service { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 }, name: Name("ntp-09e3f81f-4b30-4a91-9434-965b0b716ea0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
7712025-03-07T22:31:58.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57922
7722025-03-07T22:31:58.005ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7732025-03-07T22:31:58.005ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7742025-03-07T22:31:58.017ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7752025-03-07T22:31:58.017ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7762025-03-07T22:31:58.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7772025-03-07T22:31:58.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7782025-03-07T22:31:58.038ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7792025-03-07T22:31:58.038ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
7802025-03-07T22:31:58.038ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
7812025-03-07T22:31:58.038ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 1 num_zones_to_be_removed = 0 num_zones_updated = 0
7822025-03-07T22:31:58.038ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7832025-03-07T22:31:58.050ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7842025-03-07T22:31:58.083ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7852025-03-07T22:31:58.084ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7862025-03-07T22:31:58.084ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7872025-03-07T22:31:58.113ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 150, 231]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7882025-03-07T22:31:58.113ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = boundary_ntp
7892025-03-07T22:31:58.114ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7902025-03-07T22:31:58.114ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7912025-03-07T22:31:58.114ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7922025-03-07T22:31:58.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7932025-03-07T22:31:58.139ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0 file = illumos-utils/src/zone.rs:327
7942025-03-07T22:31:58.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0 file = illumos-utils/src/zone.rs:365
7952025-03-07T22:31:58.801ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7962025-03-07T22:31:58.801ZINFOSledAgent (ServiceManager): Booting oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
7972025-03-07T22:31:58.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 40.690151ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
7982025-03-07T22:31:58.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 95.731809ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
7992025-03-07T22:31:59.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 172.627687ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8002025-03-07T22:31:59.273ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 495.353384ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8012025-03-07T22:31:59.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 773.718911ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8022025-03-07T22:32:00.563ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 1.041766505s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8032025-03-07T22:32:01.614ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 1.437916041s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8042025-03-07T22:32:02.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7921123242625804779 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8052025-03-07T22:32:02.115ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12225070216946380756 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8062025-03-07T22:32:02.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10678064581314328160 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8072025-03-07T22:32:02.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13224156581830762376 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8082025-03-07T22:32:02.783ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/73b218dd-7dbc-4345-acb1-fe69ced4a7f7) file = sled-agent/src/nexus.rs:530 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8092025-03-07T22:32:03.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0") failed: Property not found. retry in 1.149036975s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8102025-03-07T22:32:04.231ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0
8112025-03-07T22:32:04.231ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8122025-03-07T22:32:04.232ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
8132025-03-07T22:32:04.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6227035 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57922 req_id = 601593f3-c797-4336-b796-a86f493f333e response_code = 204 uri = /omicron-zones
8142025-03-07T22:32:04.234ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:802
8152025-03-07T22:32:04.264ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8162025-03-07T22:32:04.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35382
8172025-03-07T22:32:04.273ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8182025-03-07T22:32:04.273ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35382 req_id = bb2c0622-8be6-497a-910b-a64111d6e4b0 response_code = 500 uri = /timesync
8192025-03-07T22:32:04.275ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8202025-03-07T22:32:04.450ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8212025-03-07T22:32:04.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39927
8222025-03-07T22:32:08.459ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8232025-03-07T22:32:08.459ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 4008447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39927 req_id = d03ca88e-88a1-40b6-a0f6-a9bf864bd069 response_code = 500 uri = /timesync
8242025-03-07T22:32:08.461ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12111545023512745699 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8252025-03-07T22:32:08.461ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10861152134365234497 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8262025-03-07T22:32:08.461ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11846937873600152332 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8272025-03-07T22:32:08.462ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8282025-03-07T22:32:08.621ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8292025-03-07T22:32:08.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37428
8302025-03-07T22:32:08.630ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_09e3f81f-4b30-4a91-9434-965b0b716ea0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3975
8312025-03-07T22:32:08.630ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 8916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37428 req_id = da59796a-1134-43b1-8ba7-e6d414d1838e response_code = 500 uri = /timesync
8322025-03-07T22:32:08.632ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8332025-03-07T22:32:08.762ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8342025-03-07T22:32:08.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45094
8352025-03-07T22:32:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45094 req_id = f788b301-386a-4c1a-97ac-7f504a415b42 response_code = 200 uri = /timesync
8362025-03-07T22:32:08.772ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8372025-03-07T22:32:08.772ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8382025-03-07T22:32:08.957ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8392025-03-07T22:32:08.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42579
8402025-03-07T22:32:08.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42579 req_id = c6afedaf-f822-4635-bf20-f9c8be0d2883 response_code = 200 uri = /timesync
8412025-03-07T22:32:08.966ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8422025-03-07T22:32:08.966ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8432025-03-07T22:32:09.218ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8442025-03-07T22:32:09.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34327
8452025-03-07T22:32:09.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7949 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34327 req_id = e51b43a4-a295-40d2-a28f-751c7604fc2b response_code = 200 uri = /timesync
8462025-03-07T22:32:09.228ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8472025-03-07T22:32:09.228ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8482025-03-07T22:32:09.562ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8492025-03-07T22:32:09.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45734
8502025-03-07T22:32:09.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45734 req_id = 7bbaf9b7-f85f-4e95-9e8d-dfdf550ad51d response_code = 200 uri = /timesync
8512025-03-07T22:32:09.572ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8522025-03-07T22:32:09.572ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8532025-03-07T22:32:09.798ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8542025-03-07T22:32:09.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42085
8552025-03-07T22:32:09.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42085 req_id = d5727934-3b2b-4cc0-baeb-ce65f974f443 response_code = 200 uri = /timesync
8562025-03-07T22:32:09.808ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8572025-03-07T22:32:09.808ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8582025-03-07T22:32:10.343ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8592025-03-07T22:32:10.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45824
8602025-03-07T22:32:10.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45824 req_id = 32a02490-6f50-4c09-b1a0-c856fe139e1f response_code = 200 uri = /timesync
8612025-03-07T22:32:10.353ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:810
8622025-03-07T22:32:10.353ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8632025-03-07T22:32:10.720ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8642025-03-07T22:32:10.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33651
8652025-03-07T22:32:10.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 57412e3f-031a-4113-80b3-0cc3ad225043 response_code = 200 uri = /timesync
8662025-03-07T22:32:10.731ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.045906246 } file = sled-agent/src/rack_setup/service.rs:810
8672025-03-07T22:32:10.731ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8682025-03-07T22:32:11.091ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8692025-03-07T22:32:11.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45233
8702025-03-07T22:32:11.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45233 req_id = 40910401-623c-4f13-838f-2fbda5b1b25e response_code = 200 uri = /timesync
8712025-03-07T22:32:11.101ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.044907626 } file = sled-agent/src/rack_setup/service.rs:810
8722025-03-07T22:32:11.101ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8732025-03-07T22:32:11.496ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8742025-03-07T22:32:11.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35916
8752025-03-07T22:32:11.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35916 req_id = 331a08c7-80f3-4f63-90a5-ae3d912bc9c8 response_code = 200 uri = /timesync
8762025-03-07T22:32:11.507ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.043811217 } file = sled-agent/src/rack_setup/service.rs:810
8772025-03-07T22:32:11.507ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8782025-03-07T22:32:11.947ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8792025-03-07T22:32:11.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34133
8802025-03-07T22:32:11.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34133 req_id = c80f3a67-d2d5-4052-859e-914ea62e1079 response_code = 200 uri = /timesync
8812025-03-07T22:32:11.957ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741386730.417935, correction: 0.043632399 } file = sled-agent/src/rack_setup/service.rs:810
8822025-03-07T22:32:11.957ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8832025-03-07T22:32:12.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7921123242625804779 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8842025-03-07T22:32:12.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12225070216946380756 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8852025-03-07T22:32:12.525ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10678064581314328160 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8862025-03-07T22:32:12.525ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13224156581830762376 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
8872025-03-07T22:32:13.189ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8882025-03-07T22:32:13.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64773
8892025-03-07T22:32:13.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64773 req_id = a7e2d1ea-99ce-4f0e-9c95-837104644e38 response_code = 200 uri = /timesync
8902025-03-07T22:32:13.199ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1741386730.417935, correction: 0.041629929 } file = sled-agent/src/rack_setup/service.rs:810
8912025-03-07T22:32:13.199ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:832
8922025-03-07T22:32:13.795ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:782
8932025-03-07T22:32:13.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33963
8942025-03-07T22:32:13.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33963 req_id = b55c711d-c0bc-4773-845d-9e5ca9db3f53 response_code = 200 uri = /timesync
8952025-03-07T22:32:13.819ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2429173457, ip_addr: 144.202.62.209, stratum: 3, ref_time: 1741386732.6647267, correction: 0.039904494 } file = sled-agent/src/rack_setup/service.rs:810
8962025-03-07T22:32:13.819ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1445
8972025-03-07T22:32:13.849ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: d2f04f38-7ac2-4327-a087-c2a47865841a (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a9773e0b-15d4-4efa-b977-9f3598685cdd (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 114e494f-6e94-4e0c-80db-5823b226f1a3 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 404074d8-d4b4-4a8d-887e-08e81a4d686e, kind: Service { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 }, name: Name("ntp-09e3f81f-4b30-4a91-9434-965b0b716ea0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 038a796b-79aa-4b8e-a839-2bcfec5a5383 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ec8b16bd-ee21-4926-83bd-12c5ec0671d2 (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3061ef4a-eb22-4923-a793-86348bee5620 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e60b22b8-dc58-4a39-ad66-23e1b07cc15a (service), filesystem_pool: Some(ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 75e746f4-f6b2-4e1b-b555-37db83d4338a (service), filesystem_pool: Some(ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
8982025-03-07T22:32:13.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44172
8992025-03-07T22:32:13.850ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-03-07T22:32:13.850ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9012025-03-07T22:32:13.860ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-03-07T22:32:13.860ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9032025-03-07T22:32:13.870ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-03-07T22:32:13.870ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9052025-03-07T22:32:13.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-03-07T22:32:13.880ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072025-03-07T22:32:13.889ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-03-07T22:32:13.889ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092025-03-07T22:32:13.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9102025-03-07T22:32:13.900ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112025-03-07T22:32:13.909ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9122025-03-07T22:32:13.909ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9132025-03-07T22:32:13.918ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9142025-03-07T22:32:13.918ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9152025-03-07T22:32:13.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9162025-03-07T22:32:13.927ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
9172025-03-07T22:32:13.927ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
9182025-03-07T22:32:13.927ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 5 num_zones_to_be_removed = 0 num_zones_updated = 0
9192025-03-07T22:32:13.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202025-03-07T22:32:14.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212025-03-07T22:32:14.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222025-03-07T22:32:14.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232025-03-07T22:32:14.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242025-03-07T22:32:14.014ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252025-03-07T22:32:14.105ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2 file = illumos-utils/src/zone.rs:327
9262025-03-07T22:32:14.110ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 file = illumos-utils/src/zone.rs:327
9272025-03-07T22:32:14.114ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a file = illumos-utils/src/zone.rs:327
9282025-03-07T22:32:14.118ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a file = illumos-utils/src/zone.rs:327
9292025-03-07T22:32:14.123ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620 file = illumos-utils/src/zone.rs:327
9302025-03-07T22:32:14.127ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2 file = illumos-utils/src/zone.rs:365
9312025-03-07T22:32:14.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 file = illumos-utils/src/zone.rs:365
9322025-03-07T22:32:14.137ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a file = illumos-utils/src/zone.rs:365
9332025-03-07T22:32:14.141ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a file = illumos-utils/src/zone.rs:365
9342025-03-07T22:32:14.145ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620 file = illumos-utils/src/zone.rs:365
9352025-03-07T22:32:16.515ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 162.265201ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
9362025-03-07T22:32:17.145ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='038a796b-79aa-4b8e-a839-2bcfec5a5383'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372025-03-07T22:32:17.145ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ec8b16bd-ee21-4926-83bd-12c5ec0671d2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382025-03-07T22:32:17.145ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9392025-03-07T22:32:17.151ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9402025-03-07T22:32:17.199ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3061ef4a-eb22-4923-a793-86348bee5620'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412025-03-07T22:32:17.199ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9422025-03-07T22:32:17.205ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e60b22b8-dc58-4a39-ad66-23e1b07cc15a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9432025-03-07T22:32:17.205ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='75e746f4-f6b2-4e1b-b555-37db83d4338a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9442025-03-07T22:32:17.205ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9452025-03-07T22:32:17.211ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9462025-03-07T22:32:17.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 55.389756ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9472025-03-07T22:32:17.312ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 73.755324ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9482025-03-07T22:32:17.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 71.237392ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9492025-03-07T22:32:17.349ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 54.96599ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9502025-03-07T22:32:17.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 29.616211ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9512025-03-07T22:32:17.367ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 140.44412ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9522025-03-07T22:32:17.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 146.893844ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9532025-03-07T22:32:17.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 114.720016ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9542025-03-07T22:32:18.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 267.260569ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9552025-03-07T22:32:18.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 144.478345ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9562025-03-07T22:32:18.684ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 86.069711ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9572025-03-07T22:32:18.699ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 214.169578ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9582025-03-07T22:32:18.718ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 107.089043ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9592025-03-07T22:32:18.731ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 380.695573ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9602025-03-07T22:32:18.746ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 569.060684ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9612025-03-07T22:32:18.788ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 172.166076ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9622025-03-07T22:32:18.849ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 226.999846ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9632025-03-07T22:32:18.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 222.055078ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9642025-03-07T22:32:18.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 269.998533ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9652025-03-07T22:32:19.095ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 557.857728ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9662025-03-07T22:32:19.128ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 765.279504ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9672025-03-07T22:32:19.186ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 569.928162ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9682025-03-07T22:32:19.283ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 684.484039ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9692025-03-07T22:32:19.329ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.059949367s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9702025-03-07T22:32:19.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 556.043231ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9712025-03-07T22:32:19.772ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 1.237073356s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9722025-03-07T22:32:19.917ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.219492251s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9732025-03-07T22:32:19.985ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 885.590323ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9742025-03-07T22:32:20.241ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 656.491577ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9752025-03-07T22:32:20.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 953.249001ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9762025-03-07T22:32:20.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 1.435647797s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9772025-03-07T22:32:20.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 1.313838778s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9782025-03-07T22:32:21.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 878.368472ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9792025-03-07T22:32:21.151ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.093106937s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9802025-03-07T22:32:21.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 502.611773ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9812025-03-07T22:32:21.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.385755251s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9822025-03-07T22:32:21.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 894.606043ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9832025-03-07T22:32:22.012ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46808
9842025-03-07T22:32:22.013ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46808 req_id = 919a77e4-6d96-4377-b092-f345e6d41423 response_code = 200 uri = /baseboard
9852025-03-07T22:32:22.236ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 832.306878ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9862025-03-07T22:32:22.255ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 893.072441ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9872025-03-07T22:32:22.346ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 1.255677913s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9882025-03-07T22:32:22.822ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 582.254357ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9892025-03-07T22:32:23.080ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 820.871972ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9902025-03-07T22:32:23.160ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 608.288317ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9912025-03-07T22:32:23.304ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.022343894s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9922025-03-07T22:32:23.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 688.423182ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9932025-03-07T22:32:23.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 611.493708ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9942025-03-07T22:32:23.782ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.133081321s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
9952025-03-07T22:32:23.912ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 1.253077031s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
9962025-03-07T22:32:24.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 1.391135426s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
9972025-03-07T22:32:24.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 529.632052ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
9982025-03-07T22:32:24.338ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 926.4104ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
9992025-03-07T22:32:24.778ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 901.210296ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10002025-03-07T22:32:24.930ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.35551221s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
10012025-03-07T22:32:25.180ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 1.393015712s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
10022025-03-07T22:32:25.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.163612226s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10032025-03-07T22:32:25.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 580.655727ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10042025-03-07T22:32:25.691ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 1.247437174s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10052025-03-07T22:32:26.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 841.933388ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10062025-03-07T22:32:26.299ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.20968078s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
10072025-03-07T22:32:26.453ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.222548822s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10082025-03-07T22:32:26.586ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 1.410339239s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
10092025-03-07T22:32:26.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 761.711553ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10102025-03-07T22:32:26.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 1.209592728s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10112025-03-07T22:32:27.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.091603264s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
10122025-03-07T22:32:27.689ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 886.385188ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10132025-03-07T22:32:27.725ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 1.166212053s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10142025-03-07T22:32:28.009ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 733.846289ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
10152025-03-07T22:32:28.187ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 764.961712ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10162025-03-07T22:32:28.587ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 541.485414ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10172025-03-07T22:32:28.627ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2") failed: Property not found. retry in 1.487468894s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
10182025-03-07T22:32:28.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620") failed: Property not found. retry in 1.449878337s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
10192025-03-07T22:32:28.904ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a") failed: Property not found. retry in 1.060091374s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10202025-03-07T22:32:28.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a") failed: Property not found. retry in 1.165892806s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10212025-03-07T22:32:29.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383") failed: Property not found. retry in 1.347618916s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10222025-03-07T22:32:30.082ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
10232025-03-07T22:32:30.083ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
10242025-03-07T22:32:30.083ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
10252025-03-07T22:32:30.083ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
10262025-03-07T22:32:30.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_ec8b16bd-ee21-4926-83bd-12c5ec0671d2
10272025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383
10282025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_e60b22b8-dc58-4a39-ad66-23e1b07cc15a
10292025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_75e746f4-f6b2-4e1b-b555-37db83d4338a
10302025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_cockroachdb_3061ef4a-eb22-4923-a793-86348bee5620
10312025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10322025-03-07T22:32:30.510ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
10332025-03-07T22:32:30.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 16618713 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44172 req_id = 6fd3e290-8742-49cc-b5f1-9759a7bc09dc response_code = 204 uri = /omicron-zones
10342025-03-07T22:32:30.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41837
10352025-03-07T22:32:30.575ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 29376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = a8616e6d-c53b-4fae-8de0-581219703d1d response_code = 500 uri = /cockroachdb
10362025-03-07T22:32:30.575ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a8616e6d-c53b-4fae-8de0-581219703d1d", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a8616e6d-c53b-4fae-8de0-581219703d1d" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 89.643101ms
10372025-03-07T22:32:30.691ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = d0e534f4-6f54-4750-bf4e-5aaa20fe4508 response_code = 500 uri = /cockroachdb
10382025-03-07T22:32:30.691ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d0e534f4-6f54-4750-bf4e-5aaa20fe4508", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d0e534f4-6f54-4750-bf4e-5aaa20fe4508" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 62.110938ms
10392025-03-07T22:32:30.785ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 30254 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 92ea4189-0912-4281-ac26-b7ade5054a79 response_code = 500 uri = /cockroachdb
10402025-03-07T22:32:30.785ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "92ea4189-0912-4281-ac26-b7ade5054a79", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "92ea4189-0912-4281-ac26-b7ade5054a79" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 174.222313ms
10412025-03-07T22:32:30.987ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 69ca88dc-d5c8-499e-a452-b2325ee53244 response_code = 500 uri = /cockroachdb
10422025-03-07T22:32:30.987ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "69ca88dc-d5c8-499e-a452-b2325ee53244", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "69ca88dc-d5c8-499e-a452-b2325ee53244" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 170.553704ms
10432025-03-07T22:32:31.186ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 27409 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 47bd31b7-a71d-4e70-a5eb-a618b2521d40 response_code = 500 uri = /cockroachdb
10442025-03-07T22:32:31.186ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "47bd31b7-a71d-4e70-a5eb-a618b2521d40", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "47bd31b7-a71d-4e70-a5eb-a618b2521d40" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 201.408821ms
10452025-03-07T22:32:31.415ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 8a1e643f-69b4-4396-8f28-a2599f04f86e response_code = 500 uri = /cockroachdb
10462025-03-07T22:32:31.415ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8a1e643f-69b4-4396-8f28-a2599f04f86e", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8a1e643f-69b4-4396-8f28-a2599f04f86e" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 192.248208ms
10472025-03-07T22:32:31.634ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = b856b5de-52fc-4c58-bfba-4c0ffc265c93 response_code = 500 uri = /cockroachdb
10482025-03-07T22:32:31.635ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b856b5de-52fc-4c58-bfba-4c0ffc265c93", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b856b5de-52fc-4c58-bfba-4c0ffc265c93" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 318.038489ms
10492025-03-07T22:32:31.747ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 655.98274ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
10502025-03-07T22:32:31.980ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 7df96941-181c-4ee9-a86d-be28f3eca766 response_code = 500 uri = /cockroachdb
10512025-03-07T22:32:31.981ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7df96941-181c-4ee9-a86d-be28f3eca766", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7df96941-181c-4ee9-a86d-be28f3eca766" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 369.133999ms
10522025-03-07T22:32:32.376ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 25775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 2e7cbed8-9f0b-45d9-84f4-a871f5232c36 response_code = 500 uri = /cockroachdb
10532025-03-07T22:32:32.376ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2e7cbed8-9f0b-45d9-84f4-a871f5232c36", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2e7cbed8-9f0b-45d9-84f4-a871f5232c36" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 349.726425ms
10542025-03-07T22:32:32.753ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 26128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = d9712f05-4947-4d93-8840-3137a12574e2 response_code = 500 uri = /cockroachdb
10552025-03-07T22:32:32.753ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d9712f05-4947-4d93-8840-3137a12574e2", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d9712f05-4947-4d93-8840-3137a12574e2" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 431.240351ms
10562025-03-07T22:32:33.213ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_038a796b-79aa-4b8e-a839-2bcfec5a5383 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 28424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 1efb8b80-b41e-4aa4-9ceb-78dca85e08cc response_code = 500 uri = /cockroachdb
10572025-03-07T22:32:33.214ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1efb8b80-b41e-4aa4-9ceb-78dca85e08cc", "content-length": "124", "date": "Fri, 07 Mar 2025 22:32:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1efb8b80-b41e-4aa4-9ceb-78dca85e08cc" } file = sled-agent/src/rack_setup/service.rs:1211 retry_after = 550.766629ms
10582025-03-07T22:32:33.795ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3818
10592025-03-07T22:32:51.214ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3836
10602025-03-07T22:33:08.110ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3859
10612025-03-07T22:33:08.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34344630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:41837 req_id = 3cfe88d6-5a55-4837-9016-8eb9035c59fd response_code = 204 uri = /cockroachdb
10622025-03-07T22:33:08.110ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34465
10632025-03-07T22:33:08.115ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 708.055788ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
10642025-03-07T22:33:08.146ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: d2f04f38-7ac2-4327-a087-c2a47865841a (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 }, image_source: InstallDataset }, OmicronZoneConfig { id: a9773e0b-15d4-4efa-b977-9f3598685cdd (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 }, image_source: InstallDataset }, OmicronZoneConfig { id: 114e494f-6e94-4e0c-80db-5823b226f1a3 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 }, image_source: InstallDataset }, OmicronZoneConfig { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 404074d8-d4b4-4a8d-887e-08e81a4d686e, kind: Service { id: 09e3f81f-4b30-4a91-9434-965b0b716ea0 }, name: Name("ntp-09e3f81f-4b30-4a91-9434-965b0b716ea0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } }, image_source: InstallDataset }, OmicronZoneConfig { id: 038a796b-79aa-4b8e-a839-2bcfec5a5383 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: ec8b16bd-ee21-4926-83bd-12c5ec0671d2 (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 3061ef4a-eb22-4923-a793-86348bee5620 (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: e60b22b8-dc58-4a39-ad66-23e1b07cc15a (service), filesystem_pool: Some(ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 75e746f4-f6b2-4e1b-b555-37db83d4338a (service), filesystem_pool: Some(ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 732b0e55-5ccf-4068-b771-1299f872f618 (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } }, image_source: InstallDataset }, OmicronZoneConfig { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff (service), filesystem_pool: Some(ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 (service), filesystem_pool: Some(ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: c0f69897-7f92-43db-ad47-96c3c4721128 (service), filesystem_pool: Some(ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] }, image_source: InstallDataset }, OmicronZoneConfig { id: 7b5e9a24-6b39-4a58-a275-8cc5a75195d8 (service), filesystem_pool: Some(ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 }, image_source: InstallDataset }, OmicronZoneConfig { id: ed53bb44-2150-46a9-9cf3-25264d2026d9 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: d3af987b-118d-4dff-b39e-6880dec3924c (service), filesystem_pool: Some(ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 9fbccd3a-c442-42ba-ada2-505123eb09c9 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 8f352113-24a9-4c29-b0f8-db3d14c8bdee (service), filesystem_pool: Some(ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 }, image_source: InstallDataset }, OmicronZoneConfig { id: 90fe6638-f6c0-4225-a6f8-389d99e38e25 (service), filesystem_pool: Some(ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f73f6b7a-cfc4-42c1-85aa-c9179174e886 (service), filesystem_pool: Some(ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 97dbb4e0-f269-4851-98c0-9256573be71b (service), filesystem_pool: Some(ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 48b2f6f2-b797-42f3-a6e0-c005fecf3bd8 (service), filesystem_pool: Some(ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f825b9fb-484e-4861-b3d4-6c4878ec9563 (service), filesystem_pool: Some(ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: f096a251-c8c8-4d32-ba7c-ba29d3e2d77f (service), filesystem_pool: Some(ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930 (service), filesystem_pool: Some(ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: b9a58109-84bf-4ba4-9e7b-b5251d3c990a (service), filesystem_pool: Some(ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External } } }, image_source: InstallDataset }, OmicronZoneConfig { id: 259a4acd-e2cf-4fb0-96ff-369cd0a6de80 (service), filesystem_pool: Some(ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External } } }, image_source: InstallDataset }] } file = sled-agent/src/rack_setup/service.rs:608 sled_address = [fd00:1122:3344:101::1]:12345
10652025-03-07T22:33:08.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36063
10662025-03-07T22:33:08.147ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-03-07T22:33:08.147ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10682025-03-07T22:33:08.160ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-03-07T22:33:08.160ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10702025-03-07T22:33:08.171ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-03-07T22:33:08.171ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10722025-03-07T22:33:08.182ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10732025-03-07T22:33:08.182ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10742025-03-07T22:33:08.191ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10752025-03-07T22:33:08.192ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10762025-03-07T22:33:08.201ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10772025-03-07T22:33:08.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10782025-03-07T22:33:08.211ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10792025-03-07T22:33:08.211ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802025-03-07T22:33:08.221ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10812025-03-07T22:33:08.221ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10822025-03-07T22:33:08.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10832025-03-07T22:33:08.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10842025-03-07T22:33:08.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10852025-03-07T22:33:08.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10862025-03-07T22:33:08.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10872025-03-07T22:33:08.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10882025-03-07T22:33:08.273ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10892025-03-07T22:33:08.273ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10902025-03-07T22:33:08.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10912025-03-07T22:33:08.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, kind: Crucible }, responder: ... }
10922025-03-07T22:33:08.299ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10932025-03-07T22:33:08.299ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, kind: Crucible }, responder: ... }
10942025-03-07T22:33:08.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10952025-03-07T22:33:08.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, kind: Crucible }, responder: ... }
10962025-03-07T22:33:08.322ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10972025-03-07T22:33:08.322ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, kind: Crucible }, responder: ... }
10982025-03-07T22:33:08.339ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10992025-03-07T22:33:08.339ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, kind: Crucible }, responder: ... }
11002025-03-07T22:33:08.354ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11012025-03-07T22:33:08.354ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, kind: Crucible }, responder: ... }
11022025-03-07T22:33:08.364ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11032025-03-07T22:33:08.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, kind: Crucible }, responder: ... }
11042025-03-07T22:33:08.375ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11052025-03-07T22:33:08.375ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1480 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, kind: Crucible }, responder: ... }
11062025-03-07T22:33:08.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11072025-03-07T22:33:08.396ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
11082025-03-07T22:33:08.396ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
11092025-03-07T22:33:08.396ZINFOSledAgent (ServiceManager): ensure_all_omicron_zones: request reconciliation done file = sled-agent/src/services.rs:4937 num_zones_to_be_added = 19 num_zones_to_be_removed = 0 num_zones_updated = 0
11102025-03-07T22:33:08.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11112025-03-07T22:33:08.561ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11122025-03-07T22:33:08.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132025-03-07T22:33:08.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11142025-03-07T22:33:08.573ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11152025-03-07T22:33:08.576ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11162025-03-07T22:33:08.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11172025-03-07T22:33:08.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182025-03-07T22:33:08.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11192025-03-07T22:33:08.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11202025-03-07T22:33:08.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212025-03-07T22:33:08.782ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11222025-03-07T22:33:08.782ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232025-03-07T22:33:08.782ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11242025-03-07T22:33:08.809ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11252025-03-07T22:33:08.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262025-03-07T22:33:08.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272025-03-07T22:33:08.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-03-07T22:33:08.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292025-03-07T22:33:08.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302025-03-07T22:33:08.833ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9 file = illumos-utils/src/zone.rs:327
11312025-03-07T22:33:08.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886 file = illumos-utils/src/zone.rs:327
11322025-03-07T22:33:08.845ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee file = illumos-utils/src/zone.rs:327
11332025-03-07T22:33:08.851ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b file = illumos-utils/src/zone.rs:327
11342025-03-07T22:33:08.856ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a file = illumos-utils/src/zone.rs:327
11352025-03-07T22:33:08.860ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25 file = illumos-utils/src/zone.rs:327
11362025-03-07T22:33:08.865ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8 file = illumos-utils/src/zone.rs:327
11372025-03-07T22:33:09.013ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9 file = illumos-utils/src/zone.rs:365
11382025-03-07T22:33:09.017ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886 file = illumos-utils/src/zone.rs:365
11392025-03-07T22:33:09.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee file = illumos-utils/src/zone.rs:365
11402025-03-07T22:33:09.028ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b file = illumos-utils/src/zone.rs:365
11412025-03-07T22:33:09.033ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a file = illumos-utils/src/zone.rs:365
11422025-03-07T22:33:09.037ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25 file = illumos-utils/src/zone.rs:365
11432025-03-07T22:33:09.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8 file = illumos-utils/src/zone.rs:365
11442025-03-07T22:33:09.047ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f file = illumos-utils/src/zone.rs:327
11452025-03-07T22:33:09.052ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80 file = illumos-utils/src/zone.rs:327
11462025-03-07T22:33:09.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930 file = illumos-utils/src/zone.rs:327
11472025-03-07T22:33:09.062ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c file = illumos-utils/src/zone.rs:327
11482025-03-07T22:33:09.067ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9 file = illumos-utils/src/zone.rs:327
11492025-03-07T22:33:09.072ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563 file = illumos-utils/src/zone.rs:327
11502025-03-07T22:33:09.078ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8 file = illumos-utils/src/zone.rs:327
11512025-03-07T22:33:09.085ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f file = illumos-utils/src/zone.rs:365
11522025-03-07T22:33:09.092ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80 file = illumos-utils/src/zone.rs:365
11532025-03-07T22:33:09.100ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930 file = illumos-utils/src/zone.rs:365
11542025-03-07T22:33:09.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c file = illumos-utils/src/zone.rs:365
11552025-03-07T22:33:09.124ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9 file = illumos-utils/src/zone.rs:365
11562025-03-07T22:33:09.145ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563 file = illumos-utils/src/zone.rs:365
11572025-03-07T22:33:09.167ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8 file = illumos-utils/src/zone.rs:365
11582025-03-07T22:33:09.254ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11592025-03-07T22:33:09.311ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11602025-03-07T22:33:09.368ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11612025-03-07T22:33:09.461ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11622025-03-07T22:33:09.485ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11632025-03-07T22:33:09.485ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11642025-03-07T22:33:09.666ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 221, 186]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11652025-03-07T22:33:09.666ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11662025-03-07T22:33:09.670ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11672025-03-07T22:33:09.670ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11682025-03-07T22:33:09.737ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 196, 242]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11692025-03-07T22:33:09.737ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11702025-03-07T22:33:09.738ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11712025-03-07T22:33:09.738ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11722025-03-07T22:33:09.796ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 192, 239]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11732025-03-07T22:33:09.796ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11742025-03-07T22:33:09.854ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11752025-03-07T22:33:09.858ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11762025-03-07T22:33:09.858ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11772025-03-07T22:33:09.913ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 149, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11782025-03-07T22:33:09.913ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = external_dns
11792025-03-07T22:33:09.913ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11802025-03-07T22:33:09.913ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11812025-03-07T22:33:09.914ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11822025-03-07T22:33:09.914ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11832025-03-07T22:33:09.914ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11842025-03-07T22:33:09.914ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11852025-03-07T22:33:09.915ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11862025-03-07T22:33:09.915ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11872025-03-07T22:33:09.967ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 140, 207]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11882025-03-07T22:33:09.967ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1312 zone_type = nexus
11892025-03-07T22:33:09.967ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11902025-03-07T22:33:09.968ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11912025-03-07T22:33:09.971ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11922025-03-07T22:33:09.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11932025-03-07T22:33:09.971ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11942025-03-07T22:33:09.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11952025-03-07T22:33:10.103ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11962025-03-07T22:33:10.103ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11972025-03-07T22:33:10.104ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128 file = illumos-utils/src/zone.rs:327
11982025-03-07T22:33:10.114ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618 file = illumos-utils/src/zone.rs:327
11992025-03-07T22:33:10.124ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4 file = illumos-utils/src/zone.rs:327
12002025-03-07T22:33:10.133ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12012025-03-07T22:33:10.133ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12022025-03-07T22:33:10.133ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12032025-03-07T22:33:10.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12042025-03-07T22:33:10.178ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128 file = illumos-utils/src/zone.rs:365
12052025-03-07T22:33:10.189ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618 file = illumos-utils/src/zone.rs:365
12062025-03-07T22:33:10.199ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4 file = illumos-utils/src/zone.rs:365
12072025-03-07T22:33:10.211ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12082025-03-07T22:33:10.216ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776 file = illumos-utils/src/zone.rs:327
12092025-03-07T22:33:10.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12102025-03-07T22:33:10.275ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776 file = illumos-utils/src/zone.rs:365
12112025-03-07T22:33:10.298ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff file = illumos-utils/src/zone.rs:327
12122025-03-07T22:33:10.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff file = illumos-utils/src/zone.rs:365
12132025-03-07T22:33:13.170ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2fdb0e0c-ad91-4fa9-b183-c51c41ea3851'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12142025-03-07T22:33:13.170ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4b6b943b-8f54-4490-8c0b-44b9c41087c1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12152025-03-07T22:33:13.171ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dc92507c-073b-459f-ab6d-b8c32a64e434'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12162025-03-07T22:33:13.171ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12172025-03-07T22:33:13.186ZINFOSledAgent (ServiceManager): Booting oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12182025-03-07T22:33:13.200ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12192025-03-07T22:33:13.217ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='44e06c64-2e28-4b52-a8d9-afa36e8c03a4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202025-03-07T22:33:13.218ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12212025-03-07T22:33:13.419ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a392d7b0-50bb-4de9-a232-eebb50118c53/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b4c86902-108a-4c1e-8d37-078c94dcb25e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222025-03-07T22:33:13.420ZINFOSledAgent (ServiceManager): Booting oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12232025-03-07T22:33:13.473ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a982b089-f9c2-4382-a9db-5d2adc94fb8f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242025-03-07T22:33:13.474ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12252025-03-07T22:33:14.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 50.354474ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12262025-03-07T22:33:14.161ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 38.411163ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12272025-03-07T22:33:14.161ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282025-03-07T22:33:14.170ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 40.992305ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12292025-03-07T22:33:14.179ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 32.298371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12302025-03-07T22:33:14.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 66.92393ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12312025-03-07T22:33:14.197ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 59.524445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12322025-03-07T22:33:14.198ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12332025-03-07T22:33:14.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 127.071659ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12342025-03-07T22:33:14.224ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 57.509996ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12352025-03-07T22:33:14.233ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 132.042566ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12362025-03-07T22:33:14.243ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 53.986046ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12372025-03-07T22:33:14.267ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 96.229611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12382025-03-07T22:33:14.277ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 139.883301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12392025-03-07T22:33:14.292ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 227.726683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12402025-03-07T22:33:14.308ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 177.375712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12412025-03-07T22:33:14.354ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 131.622178ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12422025-03-07T22:33:14.377ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 123.390719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12432025-03-07T22:33:14.391ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 187.780323ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12442025-03-07T22:33:14.430ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 220.453439ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12452025-03-07T22:33:14.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 68.046121ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12462025-03-07T22:33:14.500ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 490.757172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12472025-03-07T22:33:14.513ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 413.334939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12482025-03-07T22:33:14.524ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 386.342403ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12492025-03-07T22:33:14.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 502.640505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12502025-03-07T22:33:14.569ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 120.436874ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12512025-03-07T22:33:14.593ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 399.915481ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12522025-03-07T22:33:14.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 276.791283ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12532025-03-07T22:33:14.706ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 140.747118ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12542025-03-07T22:33:14.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 462.931131ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12552025-03-07T22:33:14.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 880.348877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12562025-03-07T22:33:14.940ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.018119143s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12572025-03-07T22:33:14.952ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 498.316292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12582025-03-07T22:33:15.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 617.296116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12592025-03-07T22:33:15.019ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 801.533166ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12602025-03-07T22:33:15.056ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.081502758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12612025-03-07T22:33:15.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 435.534251ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12622025-03-07T22:33:15.468ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.027234758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12632025-03-07T22:33:15.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 534.563348ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12642025-03-07T22:33:15.789ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 608.94315ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12652025-03-07T22:33:15.817ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.141605528s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12662025-03-07T22:33:15.834ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 823.689906ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12672025-03-07T22:33:16.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 517.762802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12682025-03-07T22:33:16.244ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.241103424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12692025-03-07T22:33:16.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.334286322s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12702025-03-07T22:33:16.440ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 988.817214ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12712025-03-07T22:33:16.525ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 562.205567ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12722025-03-07T22:33:16.633ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 686.586405ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12732025-03-07T22:33:16.640ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12742025-03-07T22:33:16.641ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
12752025-03-07T22:33:16.676ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 897.941444ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12762025-03-07T22:33:16.954ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2271b677-382f-4554-9cc4-ff1d832b6e31'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12772025-03-07T22:33:16.961ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
12782025-03-07T22:33:17.003ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.412681649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12792025-03-07T22:33:17.105ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.39593904s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12802025-03-07T22:33:17.118ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 68.307923ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
12812025-03-07T22:33:19.000ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 110.947152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
12822025-03-07T22:33:19.288ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.436495367s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
12832025-03-07T22:33:19.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 651.479028ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
12842025-03-07T22:33:19.350ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 168.387241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
12852025-03-07T22:33:19.363ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 871.972205ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
12862025-03-07T22:33:19.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 844.547134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
12872025-03-07T22:33:19.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 32.247669ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
12882025-03-07T22:33:19.395ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.01328439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
12892025-03-07T22:33:19.395ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12902025-03-07T22:33:19.406ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.159480647s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
12912025-03-07T22:33:19.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 784.529705ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
12922025-03-07T22:33:19.417ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='581a1cca-17d3-4df1-9557-1417f4d9ac2f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12932025-03-07T22:33:19.418ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='7b5e9a24-6b39-4a58-a275-8cc5a75195d8'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12942025-03-07T22:33:19.427ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 100.910515ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
12952025-03-07T22:33:19.427ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
12962025-03-07T22:33:19.434ZINFOSledAgent (ServiceManager): Booting oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
12972025-03-07T22:33:19.440ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
12982025-03-07T22:33:19.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 573.968244ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
12992025-03-07T22:33:19.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 109.760546ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13002025-03-07T22:33:19.616ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13012025-03-07T22:33:19.616ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13022025-03-07T22:33:19.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 68.555973ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13032025-03-07T22:33:19.671ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 246.455128ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13042025-03-07T22:33:19.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 74.179825ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13052025-03-07T22:33:19.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 35.095265ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13062025-03-07T22:33:19.717ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 111.463268ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13072025-03-07T22:33:19.744ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 96.544516ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13082025-03-07T22:33:19.773ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 111.154547ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13092025-03-07T22:33:19.842ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 104.987089ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13102025-03-07T22:33:19.852ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 126.560125ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13112025-03-07T22:33:19.862ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 34.437466ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13122025-03-07T22:33:19.894ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 219.025474ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13132025-03-07T22:33:19.909ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 61.995094ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13142025-03-07T22:33:19.933ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 574.592753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13152025-03-07T22:33:19.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 208.098937ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13162025-03-07T22:33:19.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.100616287s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
13172025-03-07T22:33:19.983ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 168.323508ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13182025-03-07T22:33:19.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 268.423711ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13192025-03-07T22:33:20.122ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 993.779404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13202025-03-07T22:33:20.135ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 396.565278ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13212025-03-07T22:33:20.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 328.26102ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13222025-03-07T22:33:20.177ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 517.415171ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13232025-03-07T22:33:20.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 734.968751ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
13242025-03-07T22:33:20.231ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 540.375838ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
13252025-03-07T22:33:20.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 998.069133ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13262025-03-07T22:33:20.275ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 582.431332ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13272025-03-07T22:33:20.421ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 885.409746ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
13282025-03-07T22:33:20.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.138392508s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13292025-03-07T22:33:20.521ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.185949205s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13302025-03-07T22:33:20.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 666.528207ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13312025-03-07T22:33:20.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.470881437s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
13322025-03-07T22:33:20.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 740.819823ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13332025-03-07T22:33:20.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 745.867954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
13342025-03-07T22:33:20.784ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.417642131s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
13352025-03-07T22:33:20.871ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.115838558s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13362025-03-07T22:33:20.965ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 985.402002ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
13372025-03-07T22:33:21.083ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 921.846235ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
13382025-03-07T22:33:21.132ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.26653526s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13392025-03-07T22:33:21.223ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.470343444s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13402025-03-07T22:33:21.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 918.736884ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13412025-03-07T22:33:21.321ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.299743815s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
13422025-03-07T22:33:21.464ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 548.424113ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13432025-03-07T22:33:21.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 581.420616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
13442025-03-07T22:33:21.663ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 665.374582ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13452025-03-07T22:33:21.732ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 606.013798ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13462025-03-07T22:33:21.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 687.618598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
13472025-03-07T22:33:21.999ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 946.440221ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13482025-03-07T22:33:22.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.347084913s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
13492025-03-07T22:33:22.026ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.492146056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13502025-03-07T22:33:22.066ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.068059193s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
13512025-03-07T22:33:22.092ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.30782416s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
13522025-03-07T22:33:22.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.172794325s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13532025-03-07T22:33:22.217ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.104625145s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
13542025-03-07T22:33:22.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.330802748s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13552025-03-07T22:33:22.355ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.083787531s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13562025-03-07T22:33:22.412ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 628.760015ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13572025-03-07T22:33:22.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.190081438s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
13582025-03-07T22:33:22.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.394584922s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
13592025-03-07T22:33:22.705ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 940.399107ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13602025-03-07T22:33:22.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.387377395s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13612025-03-07T22:33:23.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 758.625672ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13622025-03-07T22:33:23.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 525.124122ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
13632025-03-07T22:33:23.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.261231967s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
13642025-03-07T22:33:23.380ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 859.763033ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
13652025-03-07T22:33:23.392ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 507.562154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13662025-03-07T22:33:23.412ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.066028658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
13672025-03-07T22:33:23.452ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 591.807103ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13682025-03-07T22:33:23.531ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 728.258805ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13692025-03-07T22:33:23.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.138214143s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13702025-03-07T22:33:23.687ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.270547443s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
13712025-03-07T22:33:23.698ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.119614151s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
13722025-03-07T22:33:23.827ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 500.330962ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13732025-03-07T22:33:23.840ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.394750928s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
13742025-03-07T22:33:23.901ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.833811342s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
13752025-03-07T22:33:23.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 570.113584ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13762025-03-07T22:33:23.943ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772025-03-07T22:33:23.962ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
13782025-03-07T22:33:24.057ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 987.349568ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
13792025-03-07T22:33:24.058ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='13cf8a59-25cb-4617-8a41-af5f9bdb1672'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13802025-03-07T22:33:24.070ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.390693071s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
13812025-03-07T22:33:24.071ZINFOSledAgent (ServiceManager): Booting oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
13822025-03-07T22:33:24.240ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 55.27496ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
13832025-03-07T22:33:24.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.407306119s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
13842025-03-07T22:33:24.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 712.174999ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
13852025-03-07T22:33:24.287ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 26.3252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
13862025-03-07T22:33:24.307ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 128.100168ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
13872025-03-07T22:33:24.327ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 149.242168ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
13882025-03-07T22:33:24.340ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.36854425s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
13892025-03-07T22:33:24.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.490789488s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
13902025-03-07T22:33:24.447ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 167.241352ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
13912025-03-07T22:33:24.487ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 295.964439ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
13922025-03-07T22:33:24.498ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.197815262s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
13932025-03-07T22:33:24.510ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.350620037s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
13942025-03-07T22:33:24.606ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.495688562s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
13952025-03-07T22:33:24.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 235.779454ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
13962025-03-07T22:33:24.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 299.49777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
13972025-03-07T22:33:24.807ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.209981944s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
13982025-03-07T22:33:24.826ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.227334299s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
13992025-03-07T22:33:24.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.114391172s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14002025-03-07T22:33:24.967ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 927.266877ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14012025-03-07T22:33:24.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 957.285704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14022025-03-07T22:33:25.054ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.208019134s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
14032025-03-07T22:33:25.103ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 535.458574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14042025-03-07T22:33:25.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 898.384445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14052025-03-07T22:33:25.474ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 838.46167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
14062025-03-07T22:33:25.652ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 694.688462ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14072025-03-07T22:33:25.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.218417336s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
14082025-03-07T22:33:25.709ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 555.857383ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14092025-03-07T22:33:25.719ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 818.808402ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14102025-03-07T22:33:25.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.347766731s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
14112025-03-07T22:33:25.873ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 611.526932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14122025-03-07T22:33:25.906ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 619.170569ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14132025-03-07T22:33:25.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.334876357s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14142025-03-07T22:33:25.995ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.28017136s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14152025-03-07T22:33:26.028ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.362859096s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
14162025-03-07T22:33:26.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.125660779s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
14172025-03-07T22:33:26.112ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 761.220505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
14182025-03-07T22:33:26.156ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.251847332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14192025-03-07T22:33:26.271ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.449277541s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
14202025-03-07T22:33:26.280ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.231025762s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14212025-03-07T22:33:26.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.197123512s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
14222025-03-07T22:33:26.357ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 786.337317ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14232025-03-07T22:33:26.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.036629645s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14242025-03-07T22:33:26.535ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 667.003719ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14252025-03-07T22:33:26.547ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 550.138746ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14262025-03-07T22:33:26.832ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14272025-03-07T22:33:26.832ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14282025-03-07T22:33:26.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.077629295s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
14292025-03-07T22:33:26.901ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 883.739393ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
14302025-03-07T22:33:27.109ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 807.39537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14312025-03-07T22:33:27.155ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.201782862s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14322025-03-07T22:33:27.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 39.549993ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14332025-03-07T22:33:27.200ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 542.357144ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
14342025-03-07T22:33:27.212ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 733.774692ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14352025-03-07T22:33:27.220ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 849.22806ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
14362025-03-07T22:33:27.228ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 149.809102ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14372025-03-07T22:33:27.285ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 877.16232ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14382025-03-07T22:33:27.306ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.349017206s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14392025-03-07T22:33:27.389ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 257.640093ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14402025-03-07T22:33:27.402ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 776.915353ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
14412025-03-07T22:33:27.417ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.044855211s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14422025-03-07T22:33:27.520ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.142061432s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14432025-03-07T22:33:27.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 844.871982ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
14442025-03-07T22:33:27.541ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 507.228922ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14452025-03-07T22:33:27.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 359.574927ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14462025-03-07T22:33:27.730ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 811.251745ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
14472025-03-07T22:33:27.751ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.475863177s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
14482025-03-07T22:33:27.795ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.189529364s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
14492025-03-07T22:33:27.926ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 951.908371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14502025-03-07T22:33:27.957ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.147564032s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14512025-03-07T22:33:27.973ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.377847887s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
14522025-03-07T22:33:28.025ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 587.77906ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14532025-03-07T22:33:28.061ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 766.147872ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14542025-03-07T22:33:28.082ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.365027984s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
14552025-03-07T22:33:28.175ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 693.189433ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14562025-03-07T22:33:28.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 886.076106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
14572025-03-07T22:33:28.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.381119312s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14582025-03-07T22:33:28.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.096480269s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
14592025-03-07T22:33:28.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 858.35966ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14602025-03-07T22:33:28.551ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.000525129s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
14612025-03-07T22:33:28.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.499930365s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14622025-03-07T22:33:28.666ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 934.305168ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14632025-03-07T22:33:28.675ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.017366437s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14642025-03-07T22:33:28.838ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 637.609582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14652025-03-07T22:33:28.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.018835038s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14662025-03-07T22:33:28.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.361775555s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14672025-03-07T22:33:28.994ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.05093802s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
14682025-03-07T22:33:29.087ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.245519156s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
14692025-03-07T22:33:29.114ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.359121495s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14702025-03-07T22:33:29.237ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.15839763s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
14712025-03-07T22:33:29.341ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 651.760256ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14722025-03-07T22:33:29.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 666.778766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
14732025-03-07T22:33:29.457ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.163404955s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
14742025-03-07T22:33:29.486ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 860.04102ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14752025-03-07T22:33:29.495ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.451174426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
14762025-03-07T22:33:29.561ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.475346054s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
14772025-03-07T22:33:29.611ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.051959753s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14782025-03-07T22:33:29.702ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 909.243849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14792025-03-07T22:33:29.762ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 716.656108ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14802025-03-07T22:33:29.913ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 596.781476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14812025-03-07T22:33:30.007ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 686.734386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
14822025-03-07T22:33:30.043ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 651.009513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
14832025-03-07T22:33:30.059ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.06483426s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
14842025-03-07T22:33:30.081ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
14852025-03-07T22:33:30.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 544.550088ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
14862025-03-07T22:33:30.181ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
14872025-03-07T22:33:30.229ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
14882025-03-07T22:33:30.237ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
14892025-03-07T22:33:30.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 585.775569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
14902025-03-07T22:33:30.347ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.06025033s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
14912025-03-07T22:33:30.361ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.408844706s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
14922025-03-07T22:33:30.409ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.456398296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
14932025-03-07T22:33:30.485ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 648.554313ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
14942025-03-07T22:33:30.496ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.368619793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
14952025-03-07T22:33:30.522ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 918.403843ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
14962025-03-07T22:33:30.624ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.384021896s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
14972025-03-07T22:33:30.636ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 614.788808ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
14982025-03-07T22:33:30.674ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.009402479s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
14992025-03-07T22:33:30.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 658.379572ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15002025-03-07T22:33:30.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 950.182479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15012025-03-07T22:33:30.721ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.137090613s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15022025-03-07T22:33:30.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 596.845092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15032025-03-07T22:33:30.959ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 548.235897ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15042025-03-07T22:33:31.050ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 632.59651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15052025-03-07T22:33:31.138ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 901.546476ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15062025-03-07T22:33:31.150ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.312017953s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15072025-03-07T22:33:31.264ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.229460093s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15082025-03-07T22:33:31.369ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 554.853887ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15092025-03-07T22:33:31.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 712.255911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15102025-03-07T22:33:31.451ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 865.239482ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
15112025-03-07T22:33:31.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 615.368039ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15122025-03-07T22:33:31.519ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.25508723s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15132025-03-07T22:33:31.672ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.191640786s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15142025-03-07T22:33:31.694ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 949.077141ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15152025-03-07T22:33:31.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.393171584s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
15162025-03-07T22:33:31.780ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 537.136304ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
15172025-03-07T22:33:31.868ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 552.016373ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15182025-03-07T22:33:31.878ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 871.450881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15192025-03-07T22:33:31.888ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 733.412586ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15202025-03-07T22:33:31.932ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 719.19714ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15212025-03-07T22:33:32.016ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.307478296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
15222025-03-07T22:33:32.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.007118915s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15232025-03-07T22:33:32.094ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 767.712052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15242025-03-07T22:33:32.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 840.149793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15252025-03-07T22:33:32.326ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.460986367s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
15262025-03-07T22:33:32.334ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.415785999s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
15272025-03-07T22:33:32.431ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.1968265s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15282025-03-07T22:33:32.473ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 797.066757ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15292025-03-07T22:33:32.504ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.367909419s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15302025-03-07T22:33:32.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.078996909s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15312025-03-07T22:33:32.651ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 668.999998ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15322025-03-07T22:33:32.659ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 950.502216ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15332025-03-07T22:33:32.759ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 834.986118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15342025-03-07T22:33:32.783ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.176334751s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15352025-03-07T22:33:32.871ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.159827253s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15362025-03-07T22:33:32.879ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 921.212662ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15372025-03-07T22:33:32.991ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 831.102707ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15382025-03-07T22:33:33.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 804.194004ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15392025-03-07T22:33:33.107ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.168361851s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
15402025-03-07T22:33:33.279ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 736.025069ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15412025-03-07T22:33:33.328ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.468595573s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15422025-03-07T22:33:33.336ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 802.455528ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
15432025-03-07T22:33:33.604ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.164270441s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15442025-03-07T22:33:33.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.122824148s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15452025-03-07T22:33:33.638ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 540.956277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15462025-03-07T22:33:33.720ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 514.369155ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15472025-03-07T22:33:33.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.461857573s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
15482025-03-07T22:33:33.796ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.080865263s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
15492025-03-07T22:33:33.810ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.108914604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15502025-03-07T22:33:33.831ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.481422302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15512025-03-07T22:33:33.877ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 802.484138ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15522025-03-07T22:33:33.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 742.157932ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15532025-03-07T22:33:33.969ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.278810759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15542025-03-07T22:33:34.024ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 565.902151ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15552025-03-07T22:33:34.040ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 594.643826ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15562025-03-07T22:33:34.148ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.318582569s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
15572025-03-07T22:33:34.189ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 552.968993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15582025-03-07T22:33:34.252ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 636.689903ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15592025-03-07T22:33:34.291ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 519.012932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
15602025-03-07T22:33:34.600ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.429433554s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15612025-03-07T22:33:34.639ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 678.840205ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15622025-03-07T22:33:34.647ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 707.897283ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15632025-03-07T22:33:34.688ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.308207004s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15642025-03-07T22:33:34.750ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 882.113725ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15652025-03-07T22:33:34.758ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 647.27271ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15662025-03-07T22:33:34.776ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 635.671932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15672025-03-07T22:33:34.806ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 516.573882ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15682025-03-07T22:33:34.819ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 572.882063ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
15692025-03-07T22:33:34.885ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.113020547s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
15702025-03-07T22:33:34.898ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 615.713389ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15712025-03-07T22:33:34.928ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.287329311s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15722025-03-07T22:33:35.230ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 657.866073ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
15732025-03-07T22:33:35.259ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 743.439774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15742025-03-07T22:33:35.322ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 743.002079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15752025-03-07T22:33:35.330ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 609.587056ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15762025-03-07T22:33:35.339ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 565.275802ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15772025-03-07T22:33:35.364ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 628.766371ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15782025-03-07T22:33:35.401ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.000147536s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
15792025-03-07T22:33:35.414ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.227831889s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
15802025-03-07T22:33:35.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 659.99313ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15812025-03-07T22:33:35.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.05167984s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
15822025-03-07T22:33:35.528ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.406669258s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
15832025-03-07T22:33:35.644ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.081482315s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
15842025-03-07T22:33:35.899ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.205585046s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
15852025-03-07T22:33:35.915ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 954.441745ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
15862025-03-07T22:33:35.949ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 886.698132ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
15872025-03-07T22:33:35.989ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15882025-03-07T22:33:35.990ZINFOSledAgent (ServiceManager): Booting oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
15892025-03-07T22:33:36.005ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 772.27706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
15902025-03-07T22:33:36.013ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 530.14531ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
15912025-03-07T22:33:36.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.014606674s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
15922025-03-07T22:33:36.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.297342485s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
15932025-03-07T22:33:36.057ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.200159386s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
15942025-03-07T22:33:36.100ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 945.778787ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
15952025-03-07T22:33:36.113ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.40487085s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
15962025-03-07T22:33:36.229ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.123793716s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
15972025-03-07T22:33:36.248ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 43.820459ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
15982025-03-07T22:33:36.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 121.278799ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
15992025-03-07T22:33:36.424ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 810.403757ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16002025-03-07T22:33:36.436ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 115.416865ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16012025-03-07T22:33:36.543ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 971.746793ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
16022025-03-07T22:33:36.555ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 608.074277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
16032025-03-07T22:33:36.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 323.15879ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16042025-03-07T22:33:36.568ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16052025-03-07T22:33:36.568ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16062025-03-07T22:33:36.656ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 504.999715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16072025-03-07T22:33:36.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.283243929s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
16082025-03-07T22:33:36.791ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 835.299577ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
16092025-03-07T22:33:36.805ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 41.69152ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16102025-03-07T22:33:36.851ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 674.014899ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
16112025-03-07T22:33:36.864ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 54.731255ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16122025-03-07T22:33:36.886ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.066553771s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
16132025-03-07T22:33:36.905ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 594.782519ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16142025-03-07T22:33:36.962ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 156.717342ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16152025-03-07T22:33:36.980ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.214674731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
16162025-03-07T22:33:37.053ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.366406863s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
16172025-03-07T22:33:37.064ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.163983938s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
16182025-03-07T22:33:37.117ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 696.201563ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
16192025-03-07T22:33:37.131ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 381.640989ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16202025-03-07T22:33:37.132ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63245
16212025-03-07T22:33:37.134ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1492 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63245 req_id = 3f269bc3-9a74-4391-9dea-a84cc0caabe4 response_code = 200 uri = /baseboard
16222025-03-07T22:33:37.173ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 549.250708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16232025-03-07T22:33:37.188ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.262847995s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
16242025-03-07T22:33:37.289ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 760.196542ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16252025-03-07T22:33:37.305ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 834.572795ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
16262025-03-07T22:33:37.343ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.23633592s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
16272025-03-07T22:33:37.364ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.308536034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
16282025-03-07T22:33:37.516ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 1.436317951s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16292025-03-07T22:33:37.530ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 606.953625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
16302025-03-07T22:33:37.542ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 624.553234ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16312025-03-07T22:33:37.554ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.039774134s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
16322025-03-07T22:33:37.567ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.129120405s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
16332025-03-07T22:33:37.640ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 754.366961ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
16342025-03-07T22:33:37.739ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.264371794s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16352025-03-07T22:33:37.832ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 907.957204ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
16362025-03-07T22:33:37.968ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 530.275255ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
16372025-03-07T22:33:38.036ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.456386451s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
16382025-03-07T22:33:38.065ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 668.151972ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16392025-03-07T22:33:38.164ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 897.252415ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
16402025-03-07T22:33:38.182ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 865.363092ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
16412025-03-07T22:33:38.199ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 1.493041443s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16422025-03-07T22:33:38.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.17361884s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
16432025-03-07T22:33:38.247ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.105025392s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
16442025-03-07T22:33:38.248ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16452025-03-07T22:33:38.252ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9 zone file = illumos-utils/src/running_zone.rs:491 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16462025-03-07T22:33:38.418ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 761.313562ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
16472025-03-07T22:33:38.439ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 506.267773ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
16482025-03-07T22:33:38.471ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 586.987965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
16492025-03-07T22:33:38.517ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.37474037s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
16502025-03-07T22:33:38.602ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 720.373244ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
16512025-03-07T22:33:38.623ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 943.878777ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
16522025-03-07T22:33:38.637ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 54.955923ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16532025-03-07T22:33:38.693ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.250507399s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
16542025-03-07T22:33:38.710ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 57.5473ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16552025-03-07T22:33:38.731ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 712.525534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
16562025-03-07T22:33:38.803ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.281385065s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16572025-03-07T22:33:38.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 174.762641ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16582025-03-07T22:33:38.979ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.458470238s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
16592025-03-07T22:33:38.993ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 1.05883718s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16602025-03-07T22:33:39.015ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 832.991209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
16612025-03-07T22:33:39.032ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 745.151683ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16622025-03-07T22:33:39.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 540.187862ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
16632025-03-07T22:33:39.078ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 664.735842ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
16642025-03-07T22:33:39.093ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.482036097s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
16652025-03-07T22:33:39.146ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 565.173447ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16662025-03-07T22:33:39.191ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.270633556s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
16672025-03-07T22:33:39.342ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 859.621832ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
16682025-03-07T22:33:39.368ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 1.458108964s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
16692025-03-07T22:33:39.411ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.23729324s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
16702025-03-07T22:33:39.459ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 730.260594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
16712025-03-07T22:33:39.505ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.075853201s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
16722025-03-07T22:33:39.581ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.104435801s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
16732025-03-07T22:33:39.615ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.393548704s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
16742025-03-07T22:33:39.704ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 1.333316562s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
16752025-03-07T22:33:39.724ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 567.297696ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16762025-03-07T22:33:39.753ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.221471226s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
16772025-03-07T22:33:39.790ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 630.163854ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16782025-03-07T22:33:39.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 569.661828ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
16792025-03-07T22:33:39.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 1.030416284s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
16802025-03-07T22:33:39.955ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 891.43676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
16812025-03-07T22:33:40.062ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 884.769311ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
16822025-03-07T22:33:40.096ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 699.461572ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16832025-03-07T22:33:40.203ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.153563305s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
16842025-03-07T22:33:40.214ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.155681976s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
16852025-03-07T22:33:40.302ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 646.92852ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
16862025-03-07T22:33:40.433ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.147981578s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
16872025-03-07T22:33:40.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 1.003010623s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
16882025-03-07T22:33:40.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 956.224022ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
16892025-03-07T22:33:40.480ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.043996112s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
16902025-03-07T22:33:40.588ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.418348278s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
16912025-03-07T22:33:40.596ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.008777498s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
16922025-03-07T22:33:40.662ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.047355411s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
16932025-03-07T22:33:40.697ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 557.062102ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
16942025-03-07T22:33:40.800ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.767474559s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
16952025-03-07T22:33:40.813ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.164000306s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
16962025-03-07T22:33:40.841ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 546.971587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
16972025-03-07T22:33:40.861ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 648.227477ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
16982025-03-07T22:33:40.946ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 948.483923ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
16992025-03-07T22:33:40.958ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 760.127657ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17002025-03-07T22:33:40.970ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 572.170441ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17012025-03-07T22:33:40.988ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.169933677s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
17022025-03-07T22:33:41.022ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.005025807s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
17032025-03-07T22:33:41.051ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 959.474162ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17042025-03-07T22:33:41.270ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.182210555s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
17052025-03-07T22:33:41.370ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 551.498799ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
17062025-03-07T22:33:41.384ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.412728473s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
17072025-03-07T22:33:41.403ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 569.664568ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
17082025-03-07T22:33:41.437ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.340985517s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
17092025-03-07T22:33:41.463ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 800.508531ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
17102025-03-07T22:33:41.526ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 871.92092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
17112025-03-07T22:33:41.538ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 1.458054815s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
17122025-03-07T22:33:41.556ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 1.36978425s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17132025-03-07T22:33:41.599ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.015406004s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
17142025-03-07T22:33:41.619ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 1.407314913s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
17152025-03-07T22:33:41.726ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.186846303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
17162025-03-07T22:33:41.738ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 852.102128ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17172025-03-07T22:33:41.910ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 519.649029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
17182025-03-07T22:33:41.936ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.023020316s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
17192025-03-07T22:33:41.987ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 867.662655ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
17202025-03-07T22:33:42.004ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9") failed: Property not found. retry in 1.181186559s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
17212025-03-07T22:33:42.020ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.096648776s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
17222025-03-07T22:33:42.034ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 889.320754ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17232025-03-07T22:33:42.047ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 1.304539559s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
17242025-03-07T22:33:42.174ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c") failed: Property not found. retry in 1.342485952s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
17252025-03-07T22:33:42.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b") failed: Property not found. retry in 653.330829ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
17262025-03-07T22:33:42.416ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 545.238212ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
17272025-03-07T22:33:42.445ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 753.236611ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
17282025-03-07T22:33:42.467ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8") failed: Property not found. retry in 1.319821745s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
17292025-03-07T22:33:42.607ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 1.292577295s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17302025-03-07T22:33:42.632ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930") failed: Property not found. retry in 1.100795356s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
17312025-03-07T22:33:42.793ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.389797507s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
17322025-03-07T22:33:42.811ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618") failed: Property not found. retry in 1.477014525s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
17332025-03-07T22:33:42.869ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25") failed: Property not found. retry in 831.821975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
17342025-03-07T22:33:42.931ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 917.929208ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
17352025-03-07T22:33:42.948ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 1.168239574s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17362025-03-07T22:33:42.963ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 919.455816ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17372025-03-07T22:33:43.008ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a") failed: Property not found. retry in 1.000955024s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
17382025-03-07T22:33:43.023ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 892.268512ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
17392025-03-07T22:33:43.042ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee") failed: Property not found. retry in 786.268622ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
17402025-03-07T22:33:43.069ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff") failed: Property not found. retry in 927.281396ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
17412025-03-07T22:33:43.141ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886") failed: Property not found. retry in 1.005541934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
17422025-03-07T22:33:43.235ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f") failed: Property not found. retry in 925.867119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
17432025-03-07T22:33:43.374ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 978.462553ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
17442025-03-07T22:33:43.880ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 529.999388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
17452025-03-07T22:33:43.902ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 925.672482ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17462025-03-07T22:33:43.923ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 642.949105ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17472025-03-07T22:33:43.941ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80") failed: Property not found. retry in 1.055184563s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
17482025-03-07T22:33:44.145ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 1.462310501s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17492025-03-07T22:33:44.276ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 873.881537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
17502025-03-07T22:33:44.388ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776") failed: Property not found. retry in 962.547236ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
17512025-03-07T22:33:44.441ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563") failed: Property not found. retry in 1.05737223s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
17522025-03-07T22:33:44.591ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4") failed: Property not found. retry in 1.193584753s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17532025-03-07T22:33:44.855ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 752.537518ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17542025-03-07T22:33:45.178ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8") failed: Property not found. retry in 1.29093424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
17552025-03-07T22:33:45.626ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 622.371738ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17562025-03-07T22:33:45.645ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 990.13505ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17572025-03-07T22:33:46.272ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 927.865763ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17582025-03-07T22:33:46.612ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.29831067s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
17592025-03-07T22:33:46.654ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128") failed: Property not found. retry in 594.311439ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17602025-03-07T22:33:47.216ZWARNSledAgent (ServiceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9") failed: Property not found. retry in 1.438641125s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17612025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_clickhouse_ed53bb44-2150-46a9-9cf3-25264d2026d9
17622025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_f73f6b7a-cfc4-42c1-85aa-c9179174e886
17632025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_c0f69897-7f92-43db-ad47-96c3c4721128
17642025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_732b0e55-5ccf-4068-b771-1299f872f618
17652025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_8f352113-24a9-4c29-b0f8-db3d14c8bdee
17662025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_dfe169a3-7536-4b54-9593-8815d6e81dd4
17672025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_97dbb4e0-f269-4851-98c0-9256573be71b
17682025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_b9a58109-84bf-4ba4-9e7b-b5251d3c990a
17692025-03-07T22:33:48.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_90fe6638-f6c0-4225-a6f8-389d99e38e25
17702025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_oximeter_7b5e9a24-6b39-4a58-a275-8cc5a75195d8
17712025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_f096a251-c8c8-4d32-ba7c-ba29d3e2d77f
17722025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_259a4acd-e2cf-4fb0-96ff-369cd0a6de80
17732025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_nexus_0f5c512c-2fda-4cff-bbad-41e8a283d9ff
17742025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_2f1fae2c-ff2f-4299-a9ee-e4e8bf5f3930
17752025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_d3af987b-118d-4dff-b39e-6880dec3924c
17762025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_pantry_9fbccd3a-c442-42ba-ada2-505123eb09c9
17772025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_external_dns_fbf58a59-609b-4fb3-b792-2c09f3f7b776
17782025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_f825b9fb-484e-4861-b3d4-6c4878ec9563
17792025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3367 zone = oxz_crucible_48b2f6f2-b797-42f3-a6e0-c005fecf3bd8
17802025-03-07T22:33:48.684ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17812025-03-07T22:33:48.690ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:197
17822025-03-07T22:33:48.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40544930 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36063 req_id = e54f5967-7e89-4ad5-aa1d-d8f3bd96e95f response_code = 204 uri = /omicron-zones
17832025-03-07T22:33:48.698ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1468
17842025-03-07T22:33:48.704ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:857
17852025-03-07T22:33:48.706ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:870
17862025-03-07T22:33:48.738ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1070
17872025-03-07T22:33:48.740ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17882025-03-07T22:33:48.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17892025-03-07T22:33:48.946ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17902025-03-07T22:33:49.106ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17912025-03-07T22:33:49.269ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17922025-03-07T22:33:49.454ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17932025-03-07T22:33:49.609ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17942025-03-07T22:33:49.975ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17952025-03-07T22:33:50.177ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17962025-03-07T22:33:50.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17972025-03-07T22:33:51.074ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/82e3cdb7-0f87-46cf-98cd-832919b5c7ec/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1132
17982025-03-07T22:33:52.667ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "68eb6642-07d2-48ae-836f-ac2893d1ab52", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"82e3cdb7-0f87-46cf-98cd-832919b5c7ec\"", request_id: "68eb6642-07d2-48ae-836f-ac2893d1ab52" } file = sled-agent/src/rack_setup/service.rs:1132
17992025-03-07T22:33:53.053ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 18.837569729s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"9ac31fb0-c249-475e-856e-01e66342a127\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 07 Mar 2025 22:33:52 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"9ac31fb0-c249-475e-856e-01e66342a127\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
18002025-03-07T22:33:53.318ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "66ce5126-e21f-471a-8052-c535ad3025e1", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"82e3cdb7-0f87-46cf-98cd-832919b5c7ec\"", request_id: "66ce5126-e21f-471a-8052-c535ad3025e1" } file = sled-agent/src/rack_setup/service.rs:1132
18012025-03-07T22:33:55.401ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4ae412d3-e319-46ce-8413-4f4939b221bc", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "4ae412d3-e319-46ce-8413-4f4939b221bc" } file = sled-agent/src/rack_setup/service.rs:1132
18022025-03-07T22:33:56.690ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a2b99dff-307b-4494-a41f-25ee46358086", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "a2b99dff-307b-4494-a41f-25ee46358086" } file = sled-agent/src/rack_setup/service.rs:1132
18032025-03-07T22:33:58.811ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "17432e1f-77e6-4baa-b993-16f2b5bb94f6", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "17432e1f-77e6-4baa-b993-16f2b5bb94f6" } file = sled-agent/src/rack_setup/service.rs:1132
18042025-03-07T22:33:59.991ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "639d7c54-0f35-4049-800c-7cbb7ea1fa69", "content-length": "173", "date": "Fri, 07 Mar 2025 22:33:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "639d7c54-0f35-4049-800c-7cbb7ea1fa69" } file = sled-agent/src/rack_setup/service.rs:1132
18052025-03-07T22:34:02.138ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e402a870-d7e8-4241-9aa5-0febeef098af", "content-length": "173", "date": "Fri, 07 Mar 2025 22:34:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "e402a870-d7e8-4241-9aa5-0febeef098af" } file = sled-agent/src/rack_setup/service.rs:1132
18062025-03-07T22:34:04.231ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6fac34a4-8816-4bcf-888e-a5fa8d732b27", "content-length": "173", "date": "Fri, 07 Mar 2025 22:34:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "6fac34a4-8816-4bcf-888e-a5fa8d732b27" } file = sled-agent/src/rack_setup/service.rs:1132
18072025-03-07T22:34:07.168ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56571
18082025-03-07T22:34:07.168ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56571 req_id = 4ff7c957-9e9e-4ead-9e2c-a671dcf48656 response_code = 200 uri = /baseboard
18092025-03-07T22:34:08.670ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "50211e96-31f2-4a5d-b5d3-caf201ac4bc2", "content-length": "173", "date": "Fri, 07 Mar 2025 22:34:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "50211e96-31f2-4a5d-b5d3-caf201ac4bc2" } file = sled-agent/src/rack_setup/service.rs:1132
18102025-03-07T22:34:11.987ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9e40d492-d00b-47a4-93c9-391702127543", "content-length": "173", "date": "Fri, 07 Mar 2025 22:34:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"73b218dd-7dbc-4345-acb1-fe69ced4a7f7\"", request_id: "9e40d492-d00b-47a4-93c9-391702127543" } file = sled-agent/src/rack_setup/service.rs:1132
18112025-03-07T22:34:17.251ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
18122025-03-07T22:34:17.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50978
18132025-03-07T22:34:17.366ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18142025-03-07T22:34:17.366ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18152025-03-07T22:34:17.366ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
18162025-03-07T22:34:17.367ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
18172025-03-07T22:34:17.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18182025-03-07T22:34:17.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe
18192025-03-07T22:34:17.407ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18202025-03-07T22:34:17.407ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19
18212025-03-07T22:34:17.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18222025-03-07T22:34:17.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07
18232025-03-07T22:34:17.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18242025-03-07T22:34:17.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f
18252025-03-07T22:34:17.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18262025-03-07T22:34:17.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4
18272025-03-07T22:34:17.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18282025-03-07T22:34:17.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550
18292025-03-07T22:34:17.537ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18302025-03-07T22:34:17.537ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6
18312025-03-07T22:34:17.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18322025-03-07T22:34:17.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443
18332025-03-07T22:34:17.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18342025-03-07T22:34:17.585ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a392d7b0-50bb-4de9-a232-eebb50118c53
18352025-03-07T22:34:17.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 234549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50978 req_id = 776c193f-0a13-46db-9423-bfbc17e37bf8 response_code = 200 uri = /inventory
18362025-03-07T22:34:18.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53055
18372025-03-07T22:34:18.015ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18382025-03-07T22:34:18.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18392025-03-07T22:34:18.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18402025-03-07T22:34:18.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18412025-03-07T22:34:18.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422025-03-07T22:34:18.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432025-03-07T22:34:18.017ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18442025-03-07T22:34:18.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3079 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53055 req_id = 9d4f87e6-b218-46ed-8f5a-e7d1266ae1fb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18452025-03-07T22:34:18.018ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1142
18462025-03-07T22:34:18.022ZINFOSledAgent (RSS): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
18472025-03-07T22:34:18.023ZINFOSledAgent (RSS): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:197
18482025-03-07T22:34:18.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38682
18492025-03-07T22:34:18.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18502025-03-07T22:34:18.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18512025-03-07T22:34:18.256ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
18522025-03-07T22:34:18.256ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
18532025-03-07T22:34:18.268ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18542025-03-07T22:34:18.268ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe
18552025-03-07T22:34:18.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18562025-03-07T22:34:18.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19
18572025-03-07T22:34:18.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18582025-03-07T22:34:18.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07
18592025-03-07T22:34:18.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18602025-03-07T22:34:18.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f
18612025-03-07T22:34:18.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18622025-03-07T22:34:18.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4
18632025-03-07T22:34:18.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18642025-03-07T22:34:18.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550
18652025-03-07T22:34:18.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18662025-03-07T22:34:18.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6
18672025-03-07T22:34:18.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18682025-03-07T22:34:18.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443
18692025-03-07T22:34:18.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18702025-03-07T22:34:18.452ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a392d7b0-50bb-4de9-a232-eebb50118c53
18712025-03-07T22:34:18.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211440 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38682 req_id = d3bdeabb-56b8-46c2-938e-8ce81a078be8 response_code = 200 uri = /inventory
18722025-03-07T22:34:19.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35233
18732025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18742025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18752025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18762025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18772025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18782025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18792025-03-07T22:34:19.627ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18802025-03-07T22:34:19.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35233 req_id = a3ca7307-89e2-4de2-a73a-f6439b504923 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18812025-03-07T22:34:19.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50616
18822025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18832025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18842025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18852025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18862025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18872025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18882025-03-07T22:34:19.796ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18892025-03-07T22:34:19.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50616 req_id = 59643b1b-a651-46c4-82f9-7abeabad3a58 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18902025-03-07T22:34:19.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44575
18912025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18922025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18932025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18942025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
18952025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18962025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18972025-03-07T22:34:19.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18982025-03-07T22:34:19.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44575 req_id = 2359eaaa-24ec-4aea-93d2-e054e07044b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18992025-03-07T22:34:24.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51596
19002025-03-07T22:34:24.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 73ac9aa6-5ec7-4442-9061-5486bd4aa7b6 response_code = 200 uri = /vpc-routes
19012025-03-07T22:34:24.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56666
19022025-03-07T22:34:24.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56666 req_id = 9834db65-f9d8-482d-a299-a7d2378712b2 response_code = 200 uri = /v2p
19032025-03-07T22:34:24.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46574
19042025-03-07T22:34:24.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46574 req_id = 6e4888cb-3364-4f20-adad-3c1b3d40c099 response_code = 200 uri = /vpc-routes
19052025-03-07T22:34:24.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64087
19062025-03-07T22:34:24.405ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19072025-03-07T22:34:24.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19082025-03-07T22:34:24.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 190739 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64087 req_id = db8edd83-077a-4e39-983d-d217d255952c response_code = 204 uri = /switch-ports
19092025-03-07T22:34:24.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19102025-03-07T22:34:24.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19112025-03-07T22:34:24.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46574 req_id = 7edf13f6-f371-4f2b-ae57-bce35c45f823 response_code = 204 uri = /eip-gateways
19122025-03-07T22:34:24.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 067e9db9-bba8-49dc-95a9-2d4bfdefdc81 response_code = 204 uri = /eip-gateways
19132025-03-07T22:34:24.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64087 req_id = 8712139a-f296-4cc4-9b39-4bc89a509ea6 response_code = 200 uri = /network-bootstore-config
19142025-03-07T22:34:24.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61032
19152025-03-07T22:34:24.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19162025-03-07T22:34:24.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36337
19172025-03-07T22:34:24.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36337 req_id = 5f53d6fb-dee4-4cee-850f-22471f6e1114 response_code = 200 uri = /v2p
19182025-03-07T22:34:24.656ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19192025-03-07T22:34:24.656ZINFOSledAgent (bootstore): Writing ledger to /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
19202025-03-07T22:34:24.658ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:197 peer_id = pc-buskin-i86pc
19212025-03-07T22:34:24.658ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19222025-03-07T22:34:24.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64087 req_id = 8ee8ee89-4dce-4677-8359-916e45283752 response_code = 204 uri = /network-bootstore-config
19232025-03-07T22:34:24.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19242025-03-07T22:34:24.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39374
19252025-03-07T22:34:24.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39374 req_id = 315f922c-c466-47f4-ad5e-9d47c89677b6 response_code = 200 uri = /vpc-routes
19262025-03-07T22:34:24.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61032 req_id = 912d1447-e621-40db-aa31-a2fcf4353143 response_code = 204 uri = /switch-ports
19272025-03-07T22:34:24.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61032 req_id = ebfb011d-c074-409b-8152-e9dc70c58ebe response_code = 200 uri = /network-bootstore-config
19282025-03-07T22:34:24.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 2db09892-2db7-4908-8b54-c738da8db214 response_code = 204 uri = /vpc-routes
19292025-03-07T22:34:24.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19302025-03-07T22:34:24.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39374 req_id = e590cfeb-288d-4880-9c60-455fefb94bf2 response_code = 204 uri = /eip-gateways
19312025-03-07T22:34:24.900ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19322025-03-07T22:34:24.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46574 req_id = 8954b774-4ef9-4e0b-9d13-342d9aa2850d response_code = 204 uri = /vpc-routes
19332025-03-07T22:34:24.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62223
19342025-03-07T22:34:24.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62223 req_id = 155da943-410b-41b7-925b-e54dad7d39f8 response_code = 200 uri = /v2p
19352025-03-07T22:34:24.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39038
19362025-03-07T22:34:24.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19372025-03-07T22:34:25.021ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19382025-03-07T22:34:25.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39038 req_id = 338de54a-428e-4d51-b69b-0e8b545ef5dd response_code = 204 uri = /switch-ports
19392025-03-07T22:34:25.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39038 req_id = 11bc4fa9-e599-4045-b452-16cd3efebee8 response_code = 200 uri = /network-bootstore-config
19402025-03-07T22:34:25.094ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:500 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19412025-03-07T22:34:25.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39374 req_id = 03a0acf4-f379-4e04-a9af-d09191658eda response_code = 204 uri = /vpc-routes
19422025-03-07T22:34:25.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41592
19432025-03-07T22:34:25.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41592 req_id = d7440183-a5a2-4674-afec-908f42389020 response_code = 200 uri = /vpc-routes
19442025-03-07T22:34:26.049ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19452025-03-07T22:34:26.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41592 req_id = 5d1f7ffe-dc49-4a42-818e-91a9ab4fe713 response_code = 204 uri = /eip-gateways
19462025-03-07T22:34:26.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41592 req_id = 22904419-03bf-4ab4-bb7c-8e4b8ebd5baa response_code = 204 uri = /vpc-routes
19472025-03-07T22:34:30.083ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
19482025-03-07T22:34:30.083ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
19492025-03-07T22:34:30.083ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
19502025-03-07T22:34:30.083ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
19512025-03-07T22:34:37.203ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38678
19522025-03-07T22:34:37.204ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38678 req_id = b6899a75-98f4-4b21-baed-cfce553145c7 response_code = 200 uri = /baseboard
19532025-03-07T22:34:49.676ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:63164 remote_addr = [fd00:1122:3344:101::d]:49675 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
19542025-03-07T22:34:49.699ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 23170 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 82082a85-ad05-4818-8dd2-24a2f8cbebc6 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
19552025-03-07T22:34:54.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36410
19562025-03-07T22:34:54.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36410 req_id = df11390e-7274-4045-9da9-b118f4ee6308 response_code = 200 uri = /vpc-routes
19572025-03-07T22:34:54.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19582025-03-07T22:34:54.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36410 req_id = c8a07d25-8602-4201-9bdc-e908320ba684 response_code = 204 uri = /eip-gateways
19592025-03-07T22:34:54.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36410 req_id = 3681c2db-521c-43f4-a385-31d5256b31cf response_code = 204 uri = /vpc-routes
19602025-03-07T22:34:54.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62037
19612025-03-07T22:34:54.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62037 req_id = 5e86cf5d-5098-4885-aaa8-1c8ff7d05380 response_code = 200 uri = /v2p
19622025-03-07T22:34:54.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60985
19632025-03-07T22:34:54.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60985 req_id = cc9e7694-3ee4-4728-9459-97a0e055233b response_code = 200 uri = /vpc-routes
19642025-03-07T22:34:54.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19652025-03-07T22:34:54.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60985 req_id = ee5d9c9a-ad51-466b-9f29-cf65f0140d99 response_code = 204 uri = /eip-gateways
19662025-03-07T22:34:54.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60985 req_id = 0766c2b5-c271-45a6-a37d-59fefdcda095 response_code = 204 uri = /vpc-routes
19672025-03-07T22:34:54.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57432
19682025-03-07T22:34:54.534ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19692025-03-07T22:34:54.584ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19702025-03-07T22:34:54.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57432 req_id = 2f97c7c1-be43-405d-80c6-813374367eff response_code = 204 uri = /switch-ports
19712025-03-07T22:34:54.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57432 req_id = 00e73cda-d209-4837-9324-949a1ce63f06 response_code = 200 uri = /network-bootstore-config
19722025-03-07T22:34:54.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61414
19732025-03-07T22:34:54.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61414 req_id = a6ff70f5-366b-470a-b0d7-9b5b9d69bfbd response_code = 200 uri = /v2p
19742025-03-07T22:34:54.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55906
19752025-03-07T22:34:54.729ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19762025-03-07T22:34:54.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19772025-03-07T22:34:54.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55906 req_id = 605efee6-700e-4a4e-b127-ecd089db425d response_code = 204 uri = /switch-ports
19782025-03-07T22:34:54.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61123
19792025-03-07T22:34:54.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61123 req_id = ba8e1554-c761-4269-a710-d4454c8453bf response_code = 200 uri = /vpc-routes
19802025-03-07T22:34:54.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55906 req_id = 9cbdcb31-4479-40fd-9ad4-a76c6e1b0f2e response_code = 200 uri = /network-bootstore-config
19812025-03-07T22:34:54.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19822025-03-07T22:34:54.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61123 req_id = 6ecbafa2-1e4d-4404-b8c2-be8f0b578af2 response_code = 204 uri = /eip-gateways
19832025-03-07T22:34:54.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48400
19842025-03-07T22:34:54.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48400 req_id = c5ef96a9-01a5-4c54-a541-501bdbd7b250 response_code = 200 uri = /v2p
19852025-03-07T22:34:54.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61123 req_id = e6ee6145-7bc8-4149-863c-ca2583556bb6 response_code = 204 uri = /vpc-routes
19862025-03-07T22:34:55.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62844
19872025-03-07T22:34:55.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
19882025-03-07T22:34:55.265ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
19892025-03-07T22:34:55.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94070 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62844 req_id = 0fd93569-8170-42a3-9510-f784754839c1 response_code = 204 uri = /switch-ports
19902025-03-07T22:34:55.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62844 req_id = bf1032f7-ac6f-4e8a-acb5-1373c030ac8e response_code = 200 uri = /network-bootstore-config
19912025-03-07T22:35:07.245ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38400
19922025-03-07T22:35:07.245ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38400 req_id = 4976ff0c-ad7f-4d85-88db-ea99767edf74 response_code = 200 uri = /baseboard
19932025-03-07T22:35:19.681ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5940 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = cfc9c6c7-634d-48c7-a102-e8fa93f4c5da response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
19942025-03-07T22:35:24.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59525
19952025-03-07T22:35:24.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59525 req_id = 92fef545-fafb-4557-9cbe-c5aa08c36edc response_code = 200 uri = /vpc-routes
19962025-03-07T22:35:24.255ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
19972025-03-07T22:35:24.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59525 req_id = 0ca2dd24-7dc0-4955-a36d-705991334adf response_code = 204 uri = /eip-gateways
19982025-03-07T22:35:24.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49100
19992025-03-07T22:35:24.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49100 req_id = e9712237-681c-4bca-908c-3bcaf63508c2 response_code = 200 uri = /vpc-routes
20002025-03-07T22:35:24.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51197
20012025-03-07T22:35:24.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51197 req_id = f21dac0f-5ccc-4f4f-ba92-dd3ab4911d30 response_code = 200 uri = /v2p
20022025-03-07T22:35:24.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20032025-03-07T22:35:24.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49100 req_id = 666e8cfd-7724-4728-bb82-e90194ffdaa7 response_code = 204 uri = /eip-gateways
20042025-03-07T22:35:24.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49100 req_id = 472043bc-933c-4358-8c07-e1af4ed9696a response_code = 204 uri = /vpc-routes
20052025-03-07T22:35:24.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59525 req_id = 01a4ca06-dd03-43b4-96b0-967b9d1e3962 response_code = 204 uri = /vpc-routes
20062025-03-07T22:35:24.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51166
20072025-03-07T22:35:24.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20082025-03-07T22:35:24.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20092025-03-07T22:35:24.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51166 req_id = 83605975-60ef-4a32-82a4-7e0b6e281995 response_code = 204 uri = /switch-ports
20102025-03-07T22:35:24.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58567
20112025-03-07T22:35:24.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53052
20122025-03-07T22:35:24.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51166 req_id = d2bd2476-4d59-4434-a5f8-02fee60da3d6 response_code = 200 uri = /network-bootstore-config
20132025-03-07T22:35:24.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20142025-03-07T22:35:24.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53052 req_id = b01c6ace-a633-4213-859f-3d8b961d3554 response_code = 200 uri = /v2p
20152025-03-07T22:35:24.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20162025-03-07T22:35:24.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49902
20172025-03-07T22:35:24.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49902 req_id = 26bc7dd6-da9f-4532-87c7-f995fa7a5f6c response_code = 200 uri = /vpc-routes
20182025-03-07T22:35:24.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20192025-03-07T22:35:24.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49902 req_id = 9c913baf-17b5-4e41-aaf4-99101f7aa4d9 response_code = 204 uri = /eip-gateways
20202025-03-07T22:35:24.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 111131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58567 req_id = f0a97d8c-996d-4525-9bcb-36cb3a29a470 response_code = 204 uri = /switch-ports
20212025-03-07T22:35:24.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58567 req_id = 6c6c55ac-9642-4aff-a241-942bb8e412ab response_code = 200 uri = /network-bootstore-config
20222025-03-07T22:35:24.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49902 req_id = d36f71d0-6278-4003-926a-b9e85a4ca08d response_code = 204 uri = /vpc-routes
20232025-03-07T22:35:24.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45231
20242025-03-07T22:35:24.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45231 req_id = ddb3a264-d716-4b8c-b0a0-1cdf393c01ae response_code = 200 uri = /v2p
20252025-03-07T22:35:24.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53084
20262025-03-07T22:35:24.729ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20272025-03-07T22:35:24.768ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20282025-03-07T22:35:24.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53084 req_id = fe25fcf6-dc66-45da-8e96-67d741e298c7 response_code = 204 uri = /switch-ports
20292025-03-07T22:35:24.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53084 req_id = 450a7958-2936-4449-9162-036450c56526 response_code = 200 uri = /network-bootstore-config
20302025-03-07T22:35:30.082ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
20312025-03-07T22:35:30.083ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
20322025-03-07T22:35:30.083ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
20332025-03-07T22:35:30.083ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
20342025-03-07T22:35:37.277ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59306
20352025-03-07T22:35:37.278ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59306 req_id = 4863ed26-1433-471f-b221-50ad8ba13f59 response_code = 200 uri = /baseboard
20362025-03-07T22:35:49.683ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7056 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 68ae7814-9965-4a3e-abbd-151f9db23915 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
20372025-03-07T22:35:54.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56285
20382025-03-07T22:35:54.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56285 req_id = 71980d8f-a67e-454b-b5f0-50f71726384f response_code = 200 uri = /vpc-routes
20392025-03-07T22:35:54.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20402025-03-07T22:35:54.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56285 req_id = 73718ad7-6ae2-4cf6-b127-52f64c8c3fc3 response_code = 204 uri = /eip-gateways
20412025-03-07T22:35:54.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56285 req_id = d083d5d0-e021-4a59-99f0-ff25248288f5 response_code = 204 uri = /vpc-routes
20422025-03-07T22:35:54.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55736
20432025-03-07T22:35:54.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55736 req_id = 08b92faf-60d0-4da0-801a-9ddb0eb5db8b response_code = 200 uri = /vpc-routes
20442025-03-07T22:35:54.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48480
20452025-03-07T22:35:54.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48480 req_id = 3563e9ef-185b-441b-8202-86f18f58f1bd response_code = 200 uri = /v2p
20462025-03-07T22:35:54.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20472025-03-07T22:35:54.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55736 req_id = 68d91f66-d51e-490b-b166-9735bd62dd87 response_code = 204 uri = /eip-gateways
20482025-03-07T22:35:54.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39834
20492025-03-07T22:35:54.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20502025-03-07T22:35:54.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20512025-03-07T22:35:54.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 112097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39834 req_id = 49db065c-83c8-4e75-8034-395f003f9937 response_code = 204 uri = /switch-ports
20522025-03-07T22:35:54.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33888
20532025-03-07T22:35:54.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51031
20542025-03-07T22:35:54.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39834 req_id = ea3824b0-408c-4847-85a7-02d1756b58e5 response_code = 200 uri = /network-bootstore-config
20552025-03-07T22:35:54.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51031 req_id = c7a8a7d2-f123-4a69-95ed-27fa8c8b19d2 response_code = 200 uri = /v2p
20562025-03-07T22:35:54.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20572025-03-07T22:35:54.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 727 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55736 req_id = 5e30535d-9115-43c2-aa70-427a9927a92e response_code = 204 uri = /vpc-routes
20582025-03-07T22:35:54.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20592025-03-07T22:35:54.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40873
20602025-03-07T22:35:54.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40873 req_id = 09eff78f-2c7b-43bd-98f7-2d5a8f92ad46 response_code = 200 uri = /v2p
20612025-03-07T22:35:54.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33888 req_id = ce8f41db-8ef2-4db9-ba73-16584bc85250 response_code = 204 uri = /switch-ports
20622025-03-07T22:35:54.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33888 req_id = 095ff9c3-a522-40ed-a7e1-74b1acc01644 response_code = 200 uri = /network-bootstore-config
20632025-03-07T22:35:54.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47135
20642025-03-07T22:35:54.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 4d76045e-ce00-4a6b-a514-7bd44fee42a5 response_code = 200 uri = /vpc-routes
20652025-03-07T22:35:54.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20662025-03-07T22:35:54.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 2c909b3e-d6d2-430f-a347-c88702be04a2 response_code = 204 uri = /eip-gateways
20672025-03-07T22:35:54.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47980
20682025-03-07T22:35:54.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20692025-03-07T22:35:54.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20702025-03-07T22:35:55.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47980 req_id = 7966fd33-571a-41ee-b76f-8a766fcee2ef response_code = 204 uri = /switch-ports
20712025-03-07T22:35:55.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 13286008-8a6f-4d9b-89d5-ad1ae357152c response_code = 204 uri = /vpc-routes
20722025-03-07T22:35:55.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47980 req_id = 914480fd-d42d-45a8-a46c-138c7cb34dd2 response_code = 200 uri = /network-bootstore-config
20732025-03-07T22:36:07.313ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45995
20742025-03-07T22:36:07.313ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45995 req_id = f523124a-a074-4a00-b0be-66548c486089 response_code = 200 uri = /baseboard
20752025-03-07T22:36:19.682ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5740 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 26d6dd1a-af57-41a7-892b-743403366d3c response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
20762025-03-07T22:36:24.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47426
20772025-03-07T22:36:24.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47426 req_id = 10aaebb4-a7b3-4b22-87fc-4f30ad3c37e7 response_code = 200 uri = /vpc-routes
20782025-03-07T22:36:24.254ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20792025-03-07T22:36:24.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47426 req_id = 6ca65ed0-02d9-48a1-8a25-37c2b7b262e7 response_code = 204 uri = /eip-gateways
20802025-03-07T22:36:24.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47426 req_id = c413b330-1321-46c3-a13f-51407e3e5012 response_code = 204 uri = /vpc-routes
20812025-03-07T22:36:24.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61152
20822025-03-07T22:36:24.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61152 req_id = ce4b1376-1c2b-4d69-80da-0b91146003e7 response_code = 200 uri = /vpc-routes
20832025-03-07T22:36:24.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
20842025-03-07T22:36:24.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61152 req_id = 0d2d05c5-fd61-4f4d-bbde-47f83be25da4 response_code = 204 uri = /eip-gateways
20852025-03-07T22:36:24.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61152 req_id = 6dff1dad-2fc4-4e05-8648-38f82826e938 response_code = 204 uri = /vpc-routes
20862025-03-07T22:36:24.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61220
20872025-03-07T22:36:24.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20882025-03-07T22:36:24.358ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20892025-03-07T22:36:24.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94894 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61220 req_id = 2a7a0ce9-d5e3-4fb2-8dbc-dce53f66c7e9 response_code = 204 uri = /switch-ports
20902025-03-07T22:36:24.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36279
20912025-03-07T22:36:24.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38727
20922025-03-07T22:36:24.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61220 req_id = 90388766-b7f7-4556-9e93-27fc8f9921ac response_code = 200 uri = /network-bootstore-config
20932025-03-07T22:36:24.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38727 req_id = f3f88873-715b-441b-9928-2943621b8a4e response_code = 200 uri = /v2p
20942025-03-07T22:36:24.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36279 req_id = 0871c23a-972c-4876-a3e8-b67eea34baed response_code = 200 uri = /v2p
20952025-03-07T22:36:24.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57782
20962025-03-07T22:36:24.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
20972025-03-07T22:36:24.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
20982025-03-07T22:36:24.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57782 req_id = 14c79e96-2cb3-4a3f-b0d1-d5c7909383c5 response_code = 204 uri = /switch-ports
20992025-03-07T22:36:24.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57782 req_id = 3c8696b4-03ff-4a9d-8c35-c2748c5c39eb response_code = 200 uri = /network-bootstore-config
21002025-03-07T22:36:24.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36122
21012025-03-07T22:36:24.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36122 req_id = e43b8ec8-eed4-4489-b33b-2d047fe2dd1d response_code = 200 uri = /vpc-routes
21022025-03-07T22:36:24.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21032025-03-07T22:36:24.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36122 req_id = d450839b-9fde-433e-998f-58d685d142db response_code = 204 uri = /eip-gateways
21042025-03-07T22:36:24.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36122 req_id = 8e8eff65-10ec-4bf9-9bcf-932d330c41ac response_code = 204 uri = /vpc-routes
21052025-03-07T22:36:24.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51033
21062025-03-07T22:36:24.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21072025-03-07T22:36:24.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21082025-03-07T22:36:24.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51033 req_id = 1035f16b-10e8-48dc-80b8-47c0148464c3 response_code = 204 uri = /switch-ports
21092025-03-07T22:36:24.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35698
21102025-03-07T22:36:24.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35698 req_id = b8466fd4-1bbe-469c-853b-84bd8db227e3 response_code = 200 uri = /v2p
21112025-03-07T22:36:24.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51033 req_id = 16f76d28-0168-4900-b4f0-833ea4472719 response_code = 200 uri = /network-bootstore-config
21122025-03-07T22:36:30.083ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
21132025-03-07T22:36:30.083ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
21142025-03-07T22:36:30.083ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
21152025-03-07T22:36:30.083ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
21162025-03-07T22:36:37.346ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40965
21172025-03-07T22:36:37.346ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40965 req_id = 90d2a036-c711-450a-8fdd-e7716f270bf1 response_code = 200 uri = /baseboard
21182025-03-07T22:36:45.428ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
21192025-03-07T22:36:49.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5991 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = f88dc010-91d1-4f5c-a3cc-db2bf05f01f4 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
21202025-03-07T22:36:54.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37044
21212025-03-07T22:36:54.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37044 req_id = 86f9e2d3-0536-480c-b21c-dba48758824c response_code = 200 uri = /vpc-routes
21222025-03-07T22:36:54.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38549
21232025-03-07T22:36:54.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38549 req_id = 666554ba-0786-4ca9-9b1b-4ffa773ddab8 response_code = 200 uri = /v2p
21242025-03-07T22:36:54.489ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21252025-03-07T22:36:54.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37044 req_id = 0e1b8926-0618-4d68-aaee-a79ebccac253 response_code = 204 uri = /eip-gateways
21262025-03-07T22:36:54.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56486
21272025-03-07T22:36:54.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56486 req_id = 726b25e5-fa56-449f-a456-4300560094bc response_code = 200 uri = /v2p
21282025-03-07T22:36:54.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37044 req_id = 33713656-df6d-4171-bf49-178aad1d815f response_code = 204 uri = /vpc-routes
21292025-03-07T22:36:54.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44975
21302025-03-07T22:36:54.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21312025-03-07T22:36:54.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21322025-03-07T22:36:54.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44975 req_id = 6555bbc1-13ea-4240-8b6d-45e68ec3cb63 response_code = 204 uri = /switch-ports
21332025-03-07T22:36:54.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59902
21342025-03-07T22:36:54.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43167
21352025-03-07T22:36:54.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44975 req_id = 3e858f54-7641-4996-b960-130d29855a6d response_code = 200 uri = /network-bootstore-config
21362025-03-07T22:36:54.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59902 req_id = 6d9f9a5c-b6be-4596-a4ac-c0cf543cdbc3 response_code = 200 uri = /vpc-routes
21372025-03-07T22:36:54.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21382025-03-07T22:36:54.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21392025-03-07T22:36:54.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43167 req_id = f8227f64-0b11-4097-b063-7fcfba6220ad response_code = 204 uri = /switch-ports
21402025-03-07T22:36:54.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43167 req_id = 6d53d0e9-28af-4e61-84c6-96cb12bae041 response_code = 200 uri = /network-bootstore-config
21412025-03-07T22:36:54.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21422025-03-07T22:36:54.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59902 req_id = 1cd917e4-1996-401c-ba92-4e24c5b87d26 response_code = 204 uri = /eip-gateways
21432025-03-07T22:36:54.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59902 req_id = d6b78e76-c0a8-4195-b5d9-0095dbd311c6 response_code = 204 uri = /vpc-routes
21442025-03-07T22:36:54.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37723
21452025-03-07T22:36:54.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37723 req_id = 76173a53-084b-48f0-adc6-0ea4111764ce response_code = 200 uri = /v2p
21462025-03-07T22:36:54.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39114
21472025-03-07T22:36:54.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39114 req_id = ebc3ffd3-96a2-4a86-9986-2486d4f07625 response_code = 200 uri = /vpc-routes
21482025-03-07T22:36:54.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34005
21492025-03-07T22:36:54.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21502025-03-07T22:36:55.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21512025-03-07T22:36:55.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34005 req_id = b5780270-f39a-4f62-8c36-13601c6b402b response_code = 204 uri = /switch-ports
21522025-03-07T22:36:55.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21532025-03-07T22:36:55.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39114 req_id = f4b79b0f-5900-4f4b-ad1f-793cb3bca2a5 response_code = 204 uri = /eip-gateways
21542025-03-07T22:36:55.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34005 req_id = ce97b214-298c-4343-b37b-8026c56dde41 response_code = 200 uri = /network-bootstore-config
21552025-03-07T22:36:55.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39114 req_id = 2c2baa5a-85a0-421d-a5d6-d21e285c7e12 response_code = 204 uri = /vpc-routes
21562025-03-07T22:37:07.380ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58892
21572025-03-07T22:37:07.380ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58892 req_id = c8db1a64-b809-4885-87e5-d4803f8c9170 response_code = 200 uri = /baseboard
21582025-03-07T22:37:19.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7346 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 81acdb4e-3fd2-431c-955e-a66652cbf942 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
21592025-03-07T22:37:24.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61094
21602025-03-07T22:37:24.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61094 req_id = 36db63d5-934e-460f-8053-ed4df6e32580 response_code = 200 uri = /vpc-routes
21612025-03-07T22:37:24.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21622025-03-07T22:37:24.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61094 req_id = 783044f1-0b85-483e-a184-c828ee84803f response_code = 204 uri = /eip-gateways
21632025-03-07T22:37:24.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61094 req_id = 840219fa-2251-4238-aa16-71022c2660cb response_code = 204 uri = /vpc-routes
21642025-03-07T22:37:24.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56314
21652025-03-07T22:37:24.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21662025-03-07T22:37:24.306ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21672025-03-07T22:37:24.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56314 req_id = 42a8fba9-2f5b-4ec0-845f-b92c9c294c8a response_code = 204 uri = /switch-ports
21682025-03-07T22:37:24.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59454
21692025-03-07T22:37:24.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46224
21702025-03-07T22:37:24.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 24d04be3-8890-4237-9929-7059b07816ff response_code = 200 uri = /vpc-routes
21712025-03-07T22:37:24.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56314 req_id = 7dc3ab7d-d386-4786-ad8f-e7214beea2b5 response_code = 200 uri = /network-bootstore-config
21722025-03-07T22:37:24.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46224 req_id = a7bc215e-f79b-4530-b2fc-f395f5595a03 response_code = 200 uri = /v2p
21732025-03-07T22:37:24.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38616
21742025-03-07T22:37:24.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38616 req_id = bdb26af3-017c-4f46-be3b-46a9e956b715 response_code = 200 uri = /v2p
21752025-03-07T22:37:24.455ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21762025-03-07T22:37:24.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 59bdc64e-2600-4e1d-86ca-c3c5283ec3f0 response_code = 204 uri = /eip-gateways
21772025-03-07T22:37:24.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 919acb79-905a-4e5f-b29b-bbd7a8c19f46 response_code = 204 uri = /vpc-routes
21782025-03-07T22:37:24.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41583
21792025-03-07T22:37:24.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21802025-03-07T22:37:24.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21812025-03-07T22:37:24.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41583 req_id = fbf42cb6-d985-473d-884f-6014a0c2247d response_code = 204 uri = /switch-ports
21822025-03-07T22:37:24.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41583 req_id = 57b13e8a-b30a-4e47-ab10-5e6565bed58e response_code = 200 uri = /network-bootstore-config
21832025-03-07T22:37:24.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51292
21842025-03-07T22:37:24.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51292 req_id = e709e8fb-0882-43eb-9939-f387bcb504d0 response_code = 200 uri = /vpc-routes
21852025-03-07T22:37:24.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34186
21862025-03-07T22:37:24.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
21872025-03-07T22:37:24.750ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
21882025-03-07T22:37:24.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34186 req_id = d35484c1-b324-409a-9e21-3c058b869b5b response_code = 204 uri = /switch-ports
21892025-03-07T22:37:24.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35557
21902025-03-07T22:37:24.799ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
21912025-03-07T22:37:24.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51292 req_id = 6f058430-8367-4b1d-bf68-34c41bd25ead response_code = 204 uri = /eip-gateways
21922025-03-07T22:37:24.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35557 req_id = b3dc83c9-9035-4dee-9241-a1acb8b864cf response_code = 200 uri = /v2p
21932025-03-07T22:37:24.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34186 req_id = 2dbabc43-bb4e-472c-bbe2-3fee445076af response_code = 200 uri = /network-bootstore-config
21942025-03-07T22:37:24.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51292 req_id = a3f630ac-f2b9-49bb-8990-7469df2db41d response_code = 204 uri = /vpc-routes
21952025-03-07T22:37:30.084ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
21962025-03-07T22:37:30.084ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
21972025-03-07T22:37:30.084ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
21982025-03-07T22:37:30.085ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
21992025-03-07T22:37:37.414ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50509
22002025-03-07T22:37:37.414ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50509 req_id = 78840ef4-892a-41b1-a48a-df788b7ed87f response_code = 200 uri = /baseboard
22012025-03-07T22:37:49.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7157 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 139fad31-5381-466e-a679-6819dc4b5b2a response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
22022025-03-07T22:37:54.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37060
22032025-03-07T22:37:54.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37060 req_id = 1008c5e2-0e6c-4d5e-b7a4-ebe0e3c240b9 response_code = 200 uri = /vpc-routes
22042025-03-07T22:37:54.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22052025-03-07T22:37:54.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37060 req_id = 1a58f561-a8a9-4753-9f11-0b0e9e80e5e0 response_code = 204 uri = /eip-gateways
22062025-03-07T22:37:54.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38229
22072025-03-07T22:37:54.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38229 req_id = 17cdde7a-ca8d-4e7d-89dd-c3bc3985ae44 response_code = 200 uri = /vpc-routes
22082025-03-07T22:37:54.384ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22092025-03-07T22:37:54.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38229 req_id = 9f8edea1-0f53-4354-b76d-d2751e52ebf0 response_code = 204 uri = /eip-gateways
22102025-03-07T22:37:54.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38229 req_id = c9ca4f7c-a0e3-42f3-aec7-d27f09513fd5 response_code = 204 uri = /vpc-routes
22112025-03-07T22:37:54.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38130
22122025-03-07T22:37:54.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38130 req_id = 8451fce0-e731-4e30-8b22-1d036a465171 response_code = 200 uri = /v2p
22132025-03-07T22:37:54.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37060 req_id = bbb1c469-8440-468c-bd95-c7767916def7 response_code = 204 uri = /vpc-routes
22142025-03-07T22:37:54.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45228
22152025-03-07T22:37:54.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22162025-03-07T22:37:54.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22172025-03-07T22:37:54.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 132521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45228 req_id = 1cded18c-f7cf-4ba8-96bf-f62d26b7b77f response_code = 204 uri = /switch-ports
22182025-03-07T22:37:54.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61956
22192025-03-07T22:37:54.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61956 req_id = f788427f-3542-4fcd-b829-9542121b9d3e response_code = 200 uri = /v2p
22202025-03-07T22:37:54.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45228 req_id = bb38ca46-f900-45ed-acd0-d4716305f20f response_code = 200 uri = /network-bootstore-config
22212025-03-07T22:37:54.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49592
22222025-03-07T22:37:54.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22232025-03-07T22:37:54.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22242025-03-07T22:37:54.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93884 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49592 req_id = 81e906f0-4949-4882-9c1a-6940ce9ae6c1 response_code = 204 uri = /switch-ports
22252025-03-07T22:37:54.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49592 req_id = 991761d2-3f38-4528-879e-71858710bf2c response_code = 200 uri = /network-bootstore-config
22262025-03-07T22:37:54.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64432
22272025-03-07T22:37:54.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64432 req_id = ce0cf78e-c206-424a-8cd2-9cc7d519508c response_code = 200 uri = /vpc-routes
22282025-03-07T22:37:54.823ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22292025-03-07T22:37:54.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64432 req_id = 5feef063-479a-427b-8d2a-b80d1c41530f response_code = 204 uri = /eip-gateways
22302025-03-07T22:37:54.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40879
22312025-03-07T22:37:54.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40879 req_id = 548ff309-cb0d-4d68-be3c-f2bce1cd05af response_code = 200 uri = /v2p
22322025-03-07T22:37:54.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64432 req_id = f8e7df3d-090c-4a76-90fa-1b3e8ae09df1 response_code = 204 uri = /vpc-routes
22332025-03-07T22:37:54.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64941
22342025-03-07T22:37:54.936ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22352025-03-07T22:37:54.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22362025-03-07T22:37:55.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64941 req_id = 0d8f1a36-7f1e-4596-86f9-961f58f2e1be response_code = 204 uri = /switch-ports
22372025-03-07T22:37:55.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64941 req_id = 0b5b3e7d-0bbb-48a6-8d31-8a81d63d2ebc response_code = 200 uri = /network-bootstore-config
22382025-03-07T22:38:07.449ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46493
22392025-03-07T22:38:07.449ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46493 req_id = aee6eb08-eca4-4207-bc2f-a61b4b018c5e response_code = 200 uri = /baseboard
22402025-03-07T22:38:19.684ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5117 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = f07207d2-9eeb-4933-8a06-223c5c93e3f6 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
22412025-03-07T22:38:24.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54295
22422025-03-07T22:38:24.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54295 req_id = 02317274-bd17-4c24-b1c2-cc1a8687071b response_code = 200 uri = /vpc-routes
22432025-03-07T22:38:24.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22442025-03-07T22:38:24.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54295 req_id = 2801cb60-ef2e-4916-a1ed-c3b8c3704c15 response_code = 204 uri = /eip-gateways
22452025-03-07T22:38:24.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60476
22462025-03-07T22:38:24.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60476 req_id = 9aca0fc9-7602-4aee-908e-4619e936e042 response_code = 200 uri = /vpc-routes
22472025-03-07T22:38:24.250ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22482025-03-07T22:38:24.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60476 req_id = ffe22d9a-fd95-4608-b23d-6d6dd9951758 response_code = 204 uri = /eip-gateways
22492025-03-07T22:38:24.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41101
22502025-03-07T22:38:24.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41101 req_id = 8d04aa39-3257-480b-8fec-82fde4edf29a response_code = 200 uri = /v2p
22512025-03-07T22:38:24.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54295 req_id = 16384cb5-451b-47e3-b761-34bb83b689c5 response_code = 204 uri = /vpc-routes
22522025-03-07T22:38:24.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33424
22532025-03-07T22:38:24.353ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22542025-03-07T22:38:24.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22552025-03-07T22:38:24.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 114965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33424 req_id = 2f55998b-ef8c-419c-8845-a48113a80e9e response_code = 204 uri = /switch-ports
22562025-03-07T22:38:24.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47807
22572025-03-07T22:38:24.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33424 req_id = 0d3744e2-dfd7-4edf-b9da-bc3538e113db response_code = 200 uri = /network-bootstore-config
22582025-03-07T22:38:24.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60476 req_id = 12a45633-eefd-4629-a38a-2efa6284311f response_code = 204 uri = /vpc-routes
22592025-03-07T22:38:24.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47807 req_id = 62f761d1-5d7a-4830-9b4c-4b5e178afd10 response_code = 200 uri = /v2p
22602025-03-07T22:38:24.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60394
22612025-03-07T22:38:24.523ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22622025-03-07T22:38:24.561ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22632025-03-07T22:38:24.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60394 req_id = 8d9599e4-eb5f-4034-a68e-490939483c0a response_code = 204 uri = /switch-ports
22642025-03-07T22:38:24.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52989
22652025-03-07T22:38:24.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52989 req_id = 3434117f-9a1f-4510-b2d0-cff828dd2640 response_code = 200 uri = /vpc-routes
22662025-03-07T22:38:24.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60394 req_id = 11683501-4a41-49d2-82ef-42bea1c24937 response_code = 200 uri = /network-bootstore-config
22672025-03-07T22:38:24.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22682025-03-07T22:38:24.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52989 req_id = 6323e714-bb97-4495-9d90-401c3e66264a response_code = 204 uri = /eip-gateways
22692025-03-07T22:38:24.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52989 req_id = 4bba1035-e90f-489c-8efa-ff3270c99c0a response_code = 204 uri = /vpc-routes
22702025-03-07T22:38:24.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37431
22712025-03-07T22:38:24.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37431 req_id = 01b0f6c9-764f-405e-ac5a-fca17f9bf3de response_code = 200 uri = /v2p
22722025-03-07T22:38:24.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62207
22732025-03-07T22:38:24.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
22742025-03-07T22:38:24.796ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
22752025-03-07T22:38:24.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62207 req_id = fa23912b-b9d9-40c1-b9f0-007a6f36fb73 response_code = 204 uri = /switch-ports
22762025-03-07T22:38:24.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62207 req_id = a565c3d1-d412-4874-867c-d1890654a3af response_code = 200 uri = /network-bootstore-config
22772025-03-07T22:38:30.085ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
22782025-03-07T22:38:30.086ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
22792025-03-07T22:38:30.086ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
22802025-03-07T22:38:30.086ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
22812025-03-07T22:38:37.483ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54851
22822025-03-07T22:38:37.483ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54851 req_id = 6f19c32c-7a0f-4d22-a892-03bf90d97265 response_code = 200 uri = /baseboard
22832025-03-07T22:38:49.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7306 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 44188bcb-04b7-4e90-a483-35acafaf03b6 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
22842025-03-07T22:38:54.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40687
22852025-03-07T22:38:54.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40687 req_id = f42d7561-d891-4e54-a17d-8ff88e1c4cb6 response_code = 200 uri = /vpc-routes
22862025-03-07T22:38:54.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48759
22872025-03-07T22:38:54.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48759 req_id = ce605bb3-3165-478d-8e0d-731bbbb17065 response_code = 200 uri = /vpc-routes
22882025-03-07T22:38:54.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35813
22892025-03-07T22:38:54.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22902025-03-07T22:38:54.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35813 req_id = 6717efe8-6b89-4ad5-a2b8-34b88bd2d344 response_code = 200 uri = /artifacts
22912025-03-07T22:38:54.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60131
22922025-03-07T22:38:54.485ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22932025-03-07T22:38:54.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60131 req_id = c7743fe8-3c70-4dd7-b3e8-2698e001e158 response_code = 200 uri = /artifacts
22942025-03-07T22:38:54.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22952025-03-07T22:38:54.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48759 req_id = 55005848-4742-40e0-936c-a37a98387cf1 response_code = 204 uri = /eip-gateways
22962025-03-07T22:38:54.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48759 req_id = 4b9def49-0d5a-4b90-ba0c-2f8ad49edecc response_code = 204 uri = /vpc-routes
22972025-03-07T22:38:54.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
22982025-03-07T22:38:54.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40687 req_id = 1fdc1553-9ab0-42e3-918f-b4de30c6cb16 response_code = 204 uri = /eip-gateways
22992025-03-07T22:38:54.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40687 req_id = cb43d7a3-41e3-4241-8ae7-216f87d1df22 response_code = 204 uri = /vpc-routes
23002025-03-07T22:38:54.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37115
23012025-03-07T22:38:54.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37115 req_id = 4960870d-a9d5-48d4-b404-8aa344f37c88 response_code = 200 uri = /v2p
23022025-03-07T22:38:54.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61805
23032025-03-07T22:38:54.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23042025-03-07T22:38:54.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23052025-03-07T22:38:54.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61805 req_id = 6d1bbd50-ae49-4f7e-a7b2-cef1171db284 response_code = 204 uri = /switch-ports
23062025-03-07T22:38:54.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32821
23072025-03-07T22:38:54.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35250
23082025-03-07T22:38:54.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61805 req_id = fbbe7af0-b569-4173-8242-46047cb073e4 response_code = 200 uri = /network-bootstore-config
23092025-03-07T22:38:54.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35250 req_id = c820a017-9df1-4fe1-ad0d-c63042bc497a response_code = 200 uri = /v2p
23102025-03-07T22:38:54.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23112025-03-07T22:38:54.753ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23122025-03-07T22:38:54.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38119
23132025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23142025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23152025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23162025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23172025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23182025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23192025-03-07T22:38:54.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23202025-03-07T22:38:54.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 467 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38119 req_id = cfe5097e-a472-4a62-872a-d4816f42e85f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23212025-03-07T22:38:54.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32821 req_id = 607981a2-46a8-467a-bd85-6d924b26fc9b response_code = 204 uri = /switch-ports
23222025-03-07T22:38:54.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32821 req_id = f518c929-86a3-4d88-b4e2-069e43029f20 response_code = 200 uri = /network-bootstore-config
23232025-03-07T22:38:54.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64250
23242025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23252025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23262025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23272025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23282025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23292025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23302025-03-07T22:38:54.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23312025-03-07T22:38:54.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64250 req_id = 23f4d86f-4fff-43b1-96ea-85f3f9129cca response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23322025-03-07T22:38:54.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39295
23332025-03-07T22:38:54.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39295 req_id = 23098967-f247-418b-8b58-37babe5c64a5 response_code = 200 uri = /vpc-routes
23342025-03-07T22:38:54.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57700
23352025-03-07T22:38:54.941ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23362025-03-07T22:38:54.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57700 req_id = 0f09678c-57c9-4221-a97f-72c1b63dd944 response_code = 200 uri = /artifacts
23372025-03-07T22:38:54.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
23382025-03-07T22:38:54.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39295 req_id = 800963cd-659f-49fa-bcf3-895d9ce6c334 response_code = 204 uri = /eip-gateways
23392025-03-07T22:38:54.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39295 req_id = 2fb65f5e-61c3-4863-b089-2e2b61445a63 response_code = 204 uri = /vpc-routes
23402025-03-07T22:38:55.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52964
23412025-03-07T22:38:55.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23422025-03-07T22:38:55.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23432025-03-07T22:38:55.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52964 req_id = 5917c984-fe05-4edb-bf2c-d61e5e1c048c response_code = 204 uri = /switch-ports
23442025-03-07T22:38:55.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44402
23452025-03-07T22:38:55.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44402 req_id = 9206b179-4e41-467f-9a45-96b17afff73b response_code = 200 uri = /v2p
23462025-03-07T22:38:55.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52964 req_id = 4ade9834-c12c-4ccb-8457-8dc68bc80439 response_code = 200 uri = /network-bootstore-config
23472025-03-07T22:38:55.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48292
23482025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23492025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23502025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23512025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
23522025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23532025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23542025-03-07T22:38:55.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23552025-03-07T22:38:55.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48292 req_id = 92c3e7e8-025b-4c2d-8b77-0dfe1cf580a3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23562025-03-07T22:39:07.516ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64614
23572025-03-07T22:39:07.516ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64614 req_id = 0e3c64a3-921e-427c-8edc-3af19329ad5f response_code = 200 uri = /baseboard
23582025-03-07T22:39:19.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6490 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 60686c7d-d0c9-4a0f-b172-d819b6631c8d response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
23592025-03-07T22:39:24.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39427
23602025-03-07T22:39:24.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39427 req_id = 7e507bcc-842e-4a1f-8ff3-658a23b96bb0 response_code = 200 uri = /vpc-routes
23612025-03-07T22:39:24.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61069
23622025-03-07T22:39:24.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61069 req_id = 59d7574d-046c-49bb-b146-6194432e1d0c response_code = 200 uri = /vpc-routes
23632025-03-07T22:39:24.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
23642025-03-07T22:39:24.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61069 req_id = d0922317-4f44-4ea4-aa4f-8c7d4619ec66 response_code = 204 uri = /eip-gateways
23652025-03-07T22:39:24.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61069 req_id = 2bf4a561-d290-40d7-aac9-11e163883c0c response_code = 204 uri = /vpc-routes
23662025-03-07T22:39:24.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
23672025-03-07T22:39:24.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39427 req_id = e5de3d82-c5e1-4683-a12f-aa59a90af2e6 response_code = 204 uri = /eip-gateways
23682025-03-07T22:39:24.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39427 req_id = 771c90e0-25a2-4f0c-ad2e-e85ec7b65aae response_code = 204 uri = /vpc-routes
23692025-03-07T22:39:24.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57288
23702025-03-07T22:39:24.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57288 req_id = 22aab7b8-4f53-47ed-9afa-56509e187911 response_code = 200 uri = /v2p
23712025-03-07T22:39:24.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37757
23722025-03-07T22:39:24.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37757 req_id = 3129dd78-3019-4411-a822-3fb17058b833 response_code = 200 uri = /v2p
23732025-03-07T22:39:24.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46773
23742025-03-07T22:39:24.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23752025-03-07T22:39:24.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23762025-03-07T22:39:24.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 126416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46773 req_id = 84e266d7-597f-4b57-b48e-49d4faf6b54d response_code = 204 uri = /switch-ports
23772025-03-07T22:39:24.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37431
23782025-03-07T22:39:24.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23792025-03-07T22:39:24.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46773 req_id = 094b98b2-9eb6-4c7e-89e8-b197b64f2f44 response_code = 200 uri = /network-bootstore-config
23802025-03-07T22:39:24.534ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23812025-03-07T22:39:24.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119286 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37431 req_id = 64385d2b-598b-405e-bcf0-4798be18aa89 response_code = 204 uri = /switch-ports
23822025-03-07T22:39:24.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37431 req_id = 50b8a1f0-ec0d-45cf-bacc-a745084e6942 response_code = 200 uri = /network-bootstore-config
23832025-03-07T22:39:24.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43756
23842025-03-07T22:39:24.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43756 req_id = c077fa9f-8434-44a2-b8d1-d9777422f413 response_code = 200 uri = /vpc-routes
23852025-03-07T22:39:24.659ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
23862025-03-07T22:39:24.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43756 req_id = 041495d2-da0c-4d33-93bc-20c2508eb227 response_code = 204 uri = /eip-gateways
23872025-03-07T22:39:24.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43756 req_id = a38b0c3e-d20d-402d-82bd-d309b5428d64 response_code = 204 uri = /vpc-routes
23882025-03-07T22:39:24.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36077
23892025-03-07T22:39:24.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
23902025-03-07T22:39:24.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
23912025-03-07T22:39:24.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36077 req_id = 381ce173-6ad8-48bb-8778-d424b4aaf66e response_code = 204 uri = /switch-ports
23922025-03-07T22:39:24.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58440
23932025-03-07T22:39:24.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58440 req_id = 06dce578-f33f-4581-b240-0ed4314d7baf response_code = 200 uri = /v2p
23942025-03-07T22:39:24.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36077 req_id = a435529c-8d1a-4482-bbc9-42c74105ab54 response_code = 200 uri = /network-bootstore-config
23952025-03-07T22:39:30.087ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
23962025-03-07T22:39:30.087ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
23972025-03-07T22:39:30.087ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
23982025-03-07T22:39:30.087ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
23992025-03-07T22:39:37.549ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64853
24002025-03-07T22:39:37.549ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64853 req_id = 068a08d7-2626-4c11-b45f-a992a5d78af1 response_code = 200 uri = /baseboard
24012025-03-07T22:39:49.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6222 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = d23abe3b-9917-415e-bf38-815c8a91ef3a response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
24022025-03-07T22:39:54.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33561
24032025-03-07T22:39:54.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33561 req_id = 9ff7a6ee-4d42-4af5-874d-0357b7257aaa response_code = 200 uri = /vpc-routes
24042025-03-07T22:39:54.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24052025-03-07T22:39:54.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33561 req_id = 96917f84-89cc-4419-8a4a-47d7790f5f19 response_code = 204 uri = /eip-gateways
24062025-03-07T22:39:54.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43747
24072025-03-07T22:39:54.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43747 req_id = 26ee606c-34ff-4689-91a6-261390676603 response_code = 200 uri = /vpc-routes
24082025-03-07T22:39:54.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33561 req_id = 04f90aa6-7f6d-4989-8462-c88841a6296a response_code = 204 uri = /vpc-routes
24092025-03-07T22:39:54.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24102025-03-07T22:39:54.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43747 req_id = 509e54d1-8bb8-421a-a3a8-b0bce5ed1366 response_code = 204 uri = /eip-gateways
24112025-03-07T22:39:54.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43747 req_id = d2cfb474-226f-4435-bc68-e63e9d29b14d response_code = 204 uri = /vpc-routes
24122025-03-07T22:39:54.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62546
24132025-03-07T22:39:54.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62546 req_id = 6fb078df-552d-48fc-af69-aea64437cf25 response_code = 200 uri = /v2p
24142025-03-07T22:39:54.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45623
24152025-03-07T22:39:54.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24162025-03-07T22:39:54.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24172025-03-07T22:39:54.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 130452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45623 req_id = d0f63dc5-de12-45f6-9c13-67386b3401cb response_code = 204 uri = /switch-ports
24182025-03-07T22:39:54.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45623 req_id = 4d256025-48c5-4aab-a380-85aff8337deb response_code = 200 uri = /network-bootstore-config
24192025-03-07T22:39:54.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42766
24202025-03-07T22:39:54.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42766 req_id = 0dd4503a-cfa3-4648-a51f-652c201e40b0 response_code = 200 uri = /v2p
24212025-03-07T22:39:54.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33596
24222025-03-07T22:39:54.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24232025-03-07T22:39:54.792ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24242025-03-07T22:39:54.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33596 req_id = 5f2771b0-a3ff-4ee7-8e82-0970a1e408d9 response_code = 204 uri = /switch-ports
24252025-03-07T22:39:54.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53132
24262025-03-07T22:39:54.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53132 req_id = 31445274-33ce-4af6-a6a6-bb831006c0e2 response_code = 200 uri = /vpc-routes
24272025-03-07T22:39:54.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33596 req_id = ce157675-51a9-436f-b566-b20a8eda8db8 response_code = 200 uri = /network-bootstore-config
24282025-03-07T22:39:54.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24292025-03-07T22:39:54.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53132 req_id = 52f013ed-5658-4849-92c6-940702e3725b response_code = 204 uri = /eip-gateways
24302025-03-07T22:39:54.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43566
24312025-03-07T22:39:54.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43566 req_id = 29b2c786-0c52-4a29-afd1-907d48c8d009 response_code = 200 uri = /v2p
24322025-03-07T22:39:54.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53132 req_id = f54372c6-1950-4a7c-9b96-0c91f3b0b066 response_code = 204 uri = /vpc-routes
24332025-03-07T22:39:55.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48325
24342025-03-07T22:39:55.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24352025-03-07T22:39:55.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24362025-03-07T22:39:55.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94721 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48325 req_id = 32952fd0-bc5d-47ce-8cb0-1c3e6e4eb791 response_code = 204 uri = /switch-ports
24372025-03-07T22:39:55.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48325 req_id = 96d57fbe-a131-4998-98f9-99074e7dff2a response_code = 200 uri = /network-bootstore-config
24382025-03-07T22:40:07.585ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64561
24392025-03-07T22:40:07.585ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64561 req_id = cc28aa00-05d3-4ccf-be97-5516eb75edd6 response_code = 200 uri = /baseboard
24402025-03-07T22:40:19.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6531 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 62229417-65d3-4a5b-a895-a9e8cdee386e response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
24412025-03-07T22:40:24.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54765
24422025-03-07T22:40:24.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54765 req_id = cbd3a852-9b2b-414a-8df1-44ceb718b631 response_code = 200 uri = /vpc-routes
24432025-03-07T22:40:24.220ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24442025-03-07T22:40:24.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54765 req_id = b99bbf1f-6aed-4738-96e2-2caee0145094 response_code = 204 uri = /eip-gateways
24452025-03-07T22:40:24.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54765 req_id = 3f6f879e-bb8f-4c7a-b8cb-0293bd6bf5d0 response_code = 204 uri = /vpc-routes
24462025-03-07T22:40:24.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41988
24472025-03-07T22:40:24.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41988 req_id = 28e3ad37-080a-476f-9100-e0aed19e5fdf response_code = 200 uri = /v2p
24482025-03-07T22:40:24.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48696
24492025-03-07T22:40:24.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48696 req_id = 662c021a-0fd3-4f75-8c05-3705256a275e response_code = 200 uri = /vpc-routes
24502025-03-07T22:40:24.257ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24512025-03-07T22:40:24.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48696 req_id = 340533c2-4ba1-4889-b71a-6bbbce9d21a2 response_code = 204 uri = /eip-gateways
24522025-03-07T22:40:24.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48696 req_id = 1d6fecdc-ae11-478f-bd5d-4fb36e755a5e response_code = 204 uri = /vpc-routes
24532025-03-07T22:40:24.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42730
24542025-03-07T22:40:24.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24552025-03-07T22:40:24.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24562025-03-07T22:40:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42730 req_id = b9d8fc53-bb54-46e3-84b9-d0e92ac9a80f response_code = 204 uri = /switch-ports
24572025-03-07T22:40:24.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46526
24582025-03-07T22:40:24.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41627
24592025-03-07T22:40:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41627 req_id = 2ce5ac8c-6515-4f10-b0f7-984c3b2c2730 response_code = 200 uri = /v2p
24602025-03-07T22:40:24.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42730 req_id = 57b6c031-4128-4e21-93ff-d5861d3c1f41 response_code = 200 uri = /network-bootstore-config
24612025-03-07T22:40:24.385ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24622025-03-07T22:40:24.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24632025-03-07T22:40:24.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 106767 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46526 req_id = 4e4afa15-c773-4194-afb9-0924c98e9cb7 response_code = 204 uri = /switch-ports
24642025-03-07T22:40:24.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46526 req_id = 0ed9c177-3bd9-4303-a4e8-4e2dba458d89 response_code = 200 uri = /network-bootstore-config
24652025-03-07T22:40:24.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41612
24662025-03-07T22:40:24.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41612 req_id = 43da6f4a-7f1a-4c5b-a981-36e3642450cc response_code = 200 uri = /vpc-routes
24672025-03-07T22:40:24.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24682025-03-07T22:40:24.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41612 req_id = 8f06ac7d-c7c7-4378-9a15-f5c5333002fa response_code = 204 uri = /eip-gateways
24692025-03-07T22:40:24.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41612 req_id = 3c4d64cb-0c52-4353-a11d-4608c925c2d3 response_code = 204 uri = /vpc-routes
24702025-03-07T22:40:24.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58394
24712025-03-07T22:40:24.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58394 req_id = d25ff7a2-0052-4990-b2c1-21c9888178ec response_code = 200 uri = /v2p
24722025-03-07T22:40:24.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54328
24732025-03-07T22:40:24.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
24742025-03-07T22:40:24.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
24752025-03-07T22:40:24.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54328 req_id = ce966731-39ac-4bd9-8f9a-2208ba18fe57 response_code = 204 uri = /switch-ports
24762025-03-07T22:40:24.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54328 req_id = d8d0835d-d698-449c-ae1f-8700015b4d54 response_code = 200 uri = /network-bootstore-config
24772025-03-07T22:40:30.087ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
24782025-03-07T22:40:30.088ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
24792025-03-07T22:40:30.088ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
24802025-03-07T22:40:30.088ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
24812025-03-07T22:40:37.618ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50691
24822025-03-07T22:40:37.618ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50691 req_id = a6b87946-a25d-46e3-ae60-0750f0d70d93 response_code = 200 uri = /baseboard
24832025-03-07T22:40:49.688ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6315 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 965b0416-f36c-4f71-94cb-488510f248d2 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
24842025-03-07T22:40:54.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51909
24852025-03-07T22:40:54.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51909 req_id = 5bc4545e-216f-4297-be04-e57b1d04ef31 response_code = 200 uri = /v2p
24862025-03-07T22:40:54.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45436
24872025-03-07T22:40:54.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45436 req_id = 205f62a8-1829-4ecd-8650-a7ebf292af5c response_code = 200 uri = /vpc-routes
24882025-03-07T22:40:54.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46452
24892025-03-07T22:40:54.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46452 req_id = 7839b3c5-8fe9-4b24-b8fe-2d715d05154c response_code = 200 uri = /vpc-routes
24902025-03-07T22:40:54.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24912025-03-07T22:40:54.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45436 req_id = 556194cf-df81-45fa-a942-8ef3ddd8aad1 response_code = 204 uri = /eip-gateways
24922025-03-07T22:40:54.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45436 req_id = f9f0f44b-3b13-4895-9777-3e02d668f45d response_code = 204 uri = /vpc-routes
24932025-03-07T22:40:54.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40287
24942025-03-07T22:40:54.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40287 req_id = 7dc6cf9a-4302-480b-bae3-822d9bb7d1bd response_code = 200 uri = /v2p
24952025-03-07T22:40:54.503ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
24962025-03-07T22:40:54.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46452 req_id = f0de000e-dd37-45a2-bfc1-6fc2b86af720 response_code = 204 uri = /eip-gateways
24972025-03-07T22:40:54.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46452 req_id = 3b4df008-5b8f-40df-a1fa-07208a520101 response_code = 204 uri = /vpc-routes
24982025-03-07T22:40:54.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33059
24992025-03-07T22:40:54.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25002025-03-07T22:40:54.594ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25012025-03-07T22:40:54.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 121750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33059 req_id = 64931433-8445-4de4-8177-7aec182f1f23 response_code = 204 uri = /switch-ports
25022025-03-07T22:40:54.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33059 req_id = 8998bb25-e624-44a6-9983-8e66eb279f18 response_code = 200 uri = /network-bootstore-config
25032025-03-07T22:40:54.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43393
25042025-03-07T22:40:54.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25052025-03-07T22:40:54.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25062025-03-07T22:40:54.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 95125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43393 req_id = 2b5acca0-f8c4-4889-91b8-c49e0346e2c2 response_code = 204 uri = /switch-ports
25072025-03-07T22:40:54.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43393 req_id = 664fd065-8f7b-4210-9368-8f0b92ef7615 response_code = 200 uri = /network-bootstore-config
25082025-03-07T22:40:54.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53631
25092025-03-07T22:40:54.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53631 req_id = 6cfefee3-4299-4604-b5a1-3ed258d04498 response_code = 200 uri = /vpc-routes
25102025-03-07T22:40:54.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25112025-03-07T22:40:54.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53631 req_id = 7b64f6d3-08da-4342-9c5b-71531e1e4921 response_code = 204 uri = /eip-gateways
25122025-03-07T22:40:54.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53631 req_id = 7cb8b241-079c-4a5a-b207-1a4c5e82f03f response_code = 204 uri = /vpc-routes
25132025-03-07T22:40:54.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35152
25142025-03-07T22:40:54.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35152 req_id = 760c12d1-c6dc-40aa-b8b5-bc95710e3b9f response_code = 200 uri = /v2p
25152025-03-07T22:40:54.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47327
25162025-03-07T22:40:54.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25172025-03-07T22:40:54.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25182025-03-07T22:40:55.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47327 req_id = e0929088-688a-4064-b82a-56beb777109b response_code = 204 uri = /switch-ports
25192025-03-07T22:40:55.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47327 req_id = 1912ebe6-0ea4-4e62-850d-150d4d504921 response_code = 200 uri = /network-bootstore-config
25202025-03-07T22:41:07.651ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35860
25212025-03-07T22:41:07.651ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35860 req_id = 8bd5cada-a42e-449c-af07-9ae944bdc03a response_code = 200 uri = /baseboard
25222025-03-07T22:41:19.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5663 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 0fc11a7d-8927-40b5-8fee-ad75aca4f077 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
25232025-03-07T22:41:24.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60424
25242025-03-07T22:41:24.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60424 req_id = 7dfc03f6-c60d-4b3a-8fed-0eda7e06bc2d response_code = 200 uri = /vpc-routes
25252025-03-07T22:41:24.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25262025-03-07T22:41:24.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60424 req_id = e0746105-db0f-436f-b4a4-1988c7e96b61 response_code = 204 uri = /eip-gateways
25272025-03-07T22:41:24.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42937
25282025-03-07T22:41:24.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42937 req_id = 1b0f6ff8-f431-4026-8a9a-94c1b765545e response_code = 200 uri = /v2p
25292025-03-07T22:41:24.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60424 req_id = 8a0d5891-8079-4c23-9016-a9915244501f response_code = 204 uri = /vpc-routes
25302025-03-07T22:41:24.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53257
25312025-03-07T22:41:24.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53257 req_id = f117a7f0-1f4d-48a5-bb15-2f8396b05549 response_code = 200 uri = /vpc-routes
25322025-03-07T22:41:24.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62712
25332025-03-07T22:41:24.322ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25342025-03-07T22:41:24.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25352025-03-07T22:41:24.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62712 req_id = 90b72377-81c4-4741-8136-df991eece5f2 response_code = 204 uri = /switch-ports
25362025-03-07T22:41:24.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40113
25372025-03-07T22:41:24.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64428
25382025-03-07T22:41:24.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25392025-03-07T22:41:24.422ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25402025-03-07T22:41:24.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53257 req_id = 75d14113-3fcc-4b93-a295-8c57279cc3a1 response_code = 204 uri = /eip-gateways
25412025-03-07T22:41:24.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62712 req_id = 87d7b10f-1ba3-46d1-941d-252d18bfc808 response_code = 200 uri = /network-bootstore-config
25422025-03-07T22:41:24.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7410 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40113 req_id = 5a3a9b62-d893-4815-9132-775062dd106c response_code = 200 uri = /v2p
25432025-03-07T22:41:24.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53257 req_id = 91fbb5aa-0303-46c3-8cf9-54aec79cc472 response_code = 204 uri = /vpc-routes
25442025-03-07T22:41:24.481ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25452025-03-07T22:41:24.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64428 req_id = 39e87915-7f9c-48f7-8841-d2594cce4612 response_code = 204 uri = /switch-ports
25462025-03-07T22:41:24.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64428 req_id = b14d568d-a708-4408-accf-0ad9d6800981 response_code = 200 uri = /network-bootstore-config
25472025-03-07T22:41:24.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39312
25482025-03-07T22:41:24.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39312 req_id = a96fb6c7-f0ec-40af-a0b8-7eaf62e13ae5 response_code = 200 uri = /vpc-routes
25492025-03-07T22:41:24.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25502025-03-07T22:41:24.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39312 req_id = 6790c08e-6104-4be9-a2a8-67a64699b2d1 response_code = 204 uri = /eip-gateways
25512025-03-07T22:41:24.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63938
25522025-03-07T22:41:24.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63938 req_id = 7af2b24d-a5fd-4845-92e8-ce1b450ebe42 response_code = 200 uri = /v2p
25532025-03-07T22:41:24.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39312 req_id = 6886ccee-f398-49bb-b5be-a9c81fe6bdfb response_code = 204 uri = /vpc-routes
25542025-03-07T22:41:24.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54407
25552025-03-07T22:41:24.732ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25562025-03-07T22:41:24.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25572025-03-07T22:41:24.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54407 req_id = 99475515-903e-4596-92f7-331df9add8f0 response_code = 204 uri = /switch-ports
25582025-03-07T22:41:24.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54407 req_id = 203cde6e-38ad-4fa5-b11d-96c2ee9d33b1 response_code = 200 uri = /network-bootstore-config
25592025-03-07T22:41:30.089ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
25602025-03-07T22:41:30.090ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
25612025-03-07T22:41:30.090ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
25622025-03-07T22:41:30.090ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
25632025-03-07T22:41:31.199ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:219
25642025-03-07T22:41:31.199ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25652025-03-07T22:41:31.228ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:208 next_cleanup = Instant { tv_sec: 1849, tv_nsec: 579841891 } time_to_next_cleanup = 599.99999556s
25662025-03-07T22:41:37.683ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50692
25672025-03-07T22:41:37.683ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50692 req_id = 0e494fc7-7ecb-4e35-8866-ad7fab33357f response_code = 200 uri = /baseboard
25682025-03-07T22:41:45.434ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:924
25692025-03-07T22:41:49.688ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6026 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = ac9810ba-bf3d-419d-9034-b29a7801c5e4 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
25702025-03-07T22:41:54.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59442
25712025-03-07T22:41:54.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59442 req_id = 4e21516d-c4e6-4849-aebe-1ea0061e0de3 response_code = 200 uri = /vpc-routes
25722025-03-07T22:41:54.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25732025-03-07T22:41:54.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59442 req_id = 0925464a-3fae-4b34-9e9c-79714212afe9 response_code = 204 uri = /eip-gateways
25742025-03-07T22:41:54.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59442 req_id = 68a177b2-6269-4b45-b460-830b35560cda response_code = 204 uri = /vpc-routes
25752025-03-07T22:41:54.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59736
25762025-03-07T22:41:54.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59736 req_id = b1544888-7285-475f-bc26-8ef93d1aadb2 response_code = 200 uri = /vpc-routes
25772025-03-07T22:41:54.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25782025-03-07T22:41:54.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59736 req_id = 4773359b-d32f-4f36-83d5-e92022ee2be5 response_code = 204 uri = /eip-gateways
25792025-03-07T22:41:54.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42236
25802025-03-07T22:41:54.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42236 req_id = ef092676-5acb-4b4f-9d5e-244ba97b64b2 response_code = 200 uri = /v2p
25812025-03-07T22:41:54.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42572
25822025-03-07T22:41:54.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42572 req_id = 32c8b8af-79f7-41a1-9a8d-4642ecd10f37 response_code = 200 uri = /v2p
25832025-03-07T22:41:54.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59736 req_id = a867871f-9e2b-4734-9723-849e4659476f response_code = 204 uri = /vpc-routes
25842025-03-07T22:41:54.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34052
25852025-03-07T22:41:54.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25862025-03-07T22:41:54.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25872025-03-07T22:41:54.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34052 req_id = b9b224e2-296c-4da7-a4c9-465ad45f623d response_code = 204 uri = /switch-ports
25882025-03-07T22:41:54.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41937
25892025-03-07T22:41:54.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34052 req_id = 2c08aa3d-0792-41d7-bbda-fd9d4f02da3e response_code = 200 uri = /network-bootstore-config
25902025-03-07T22:41:54.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
25912025-03-07T22:41:54.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
25922025-03-07T22:41:54.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57929
25932025-03-07T22:41:54.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57929 req_id = eb555ce7-fa76-4e39-bfd4-1bbddcd7691d response_code = 200 uri = /vpc-routes
25942025-03-07T22:41:54.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 91337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41937 req_id = 7cd166ed-0294-491d-bfa8-a2ee524eabd1 response_code = 204 uri = /switch-ports
25952025-03-07T22:41:54.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41937 req_id = d828ee7e-1dee-49f0-b2f3-9eb8f353408f response_code = 200 uri = /network-bootstore-config
25962025-03-07T22:41:54.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
25972025-03-07T22:41:54.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57929 req_id = b2ea37ff-9e78-4e6a-b420-172a73c36aeb response_code = 204 uri = /eip-gateways
25982025-03-07T22:41:54.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57929 req_id = 8d40bea0-4b23-481c-bb99-5a29a31f2596 response_code = 204 uri = /vpc-routes
25992025-03-07T22:41:54.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48893
26002025-03-07T22:41:54.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26012025-03-07T22:41:54.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26022025-03-07T22:41:54.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 92856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48893 req_id = 3002dbec-0dfe-4965-a3da-346c2c793b0e response_code = 204 uri = /switch-ports
26032025-03-07T22:41:54.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64235
26042025-03-07T22:41:54.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48893 req_id = 13103ec8-cbb1-4843-819c-71bfc70b9ef9 response_code = 200 uri = /network-bootstore-config
26052025-03-07T22:41:54.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64235 req_id = 9c8a2c12-c36b-4802-bba1-1fd845a0c5eb response_code = 200 uri = /v2p
26062025-03-07T22:42:07.717ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36535
26072025-03-07T22:42:07.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36535 req_id = 3c48d4ad-cd52-440c-9a3e-eb5615d39286 response_code = 200 uri = /baseboard
26082025-03-07T22:42:19.690ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7059 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 5e7cb25f-e176-42dc-9048-89255f331e81 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
26092025-03-07T22:42:24.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64349
26102025-03-07T22:42:24.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 62ad5f40-09c4-440d-a265-b40a3fd32c71 response_code = 200 uri = /vpc-routes
26112025-03-07T22:42:24.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26122025-03-07T22:42:24.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 70aca02c-7b47-4d9a-bf17-9dd47fbb0d71 response_code = 204 uri = /eip-gateways
26132025-03-07T22:42:24.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 48d553e5-6098-4a26-bcb8-1bc207c5e97b response_code = 204 uri = /vpc-routes
26142025-03-07T22:42:24.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52486
26152025-03-07T22:42:24.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52486 req_id = 9f24fecd-05c5-4720-a1d8-bac4449311c2 response_code = 200 uri = /vpc-routes
26162025-03-07T22:42:24.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48309
26172025-03-07T22:42:24.250ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26182025-03-07T22:42:24.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26192025-03-07T22:42:24.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48309 req_id = 337a00c6-26e8-493e-9096-e0896311dec7 response_code = 204 uri = /switch-ports
26202025-03-07T22:42:24.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55786
26212025-03-07T22:42:24.348ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26222025-03-07T22:42:24.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52486 req_id = 44ee6b69-15df-4651-96c5-e2aac536dd3c response_code = 204 uri = /eip-gateways
26232025-03-07T22:42:24.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48309 req_id = 0180e231-8c61-4cac-a8e6-c4d6418b8122 response_code = 200 uri = /network-bootstore-config
26242025-03-07T22:42:24.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55786 req_id = 7f1fc079-e485-450a-af35-07fb91f08ad8 response_code = 200 uri = /v2p
26252025-03-07T22:42:24.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41517
26262025-03-07T22:42:24.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41517 req_id = d5050915-4dac-4501-b4ed-54b12ad37304 response_code = 200 uri = /v2p
26272025-03-07T22:42:24.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52486 req_id = d2ed4392-8451-4e50-a111-42e7eb4f482f response_code = 204 uri = /vpc-routes
26282025-03-07T22:42:24.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35624
26292025-03-07T22:42:24.421ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26302025-03-07T22:42:24.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26312025-03-07T22:42:24.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 133312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35624 req_id = ddf919da-39ba-49e0-9342-db24d521c6c3 response_code = 204 uri = /switch-ports
26322025-03-07T22:42:24.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35624 req_id = f9eba1aa-9a46-4d61-bbd9-58c908c61404 response_code = 200 uri = /network-bootstore-config
26332025-03-07T22:42:24.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35659
26342025-03-07T22:42:24.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35659 req_id = a02cde55-c1be-4899-ae54-f33cf8055c91 response_code = 200 uri = /vpc-routes
26352025-03-07T22:42:24.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26362025-03-07T22:42:24.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35659 req_id = 7316b2bc-8f26-42e6-bc28-048ffc904450 response_code = 204 uri = /eip-gateways
26372025-03-07T22:42:24.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35659 req_id = 1f88711a-4ac0-4af9-b32b-eb41d52cbf3d response_code = 204 uri = /vpc-routes
26382025-03-07T22:42:24.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57655
26392025-03-07T22:42:24.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57655 req_id = 103bc315-f360-4afe-a0ba-dd1c1ca2e46b response_code = 200 uri = /v2p
26402025-03-07T22:42:24.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61357
26412025-03-07T22:42:24.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26422025-03-07T22:42:24.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26432025-03-07T22:42:24.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61357 req_id = dc6eea76-5507-4202-a486-06c6a2a6e88e response_code = 204 uri = /switch-ports
26442025-03-07T22:42:24.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61357 req_id = 8ee67006-a471-4975-b578-faa369157706 response_code = 200 uri = /network-bootstore-config
26452025-03-07T22:42:30.090ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
26462025-03-07T22:42:30.091ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
26472025-03-07T22:42:30.091ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
26482025-03-07T22:42:30.091ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
26492025-03-07T22:42:37.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49951
26502025-03-07T22:42:37.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49951 req_id = 50654ea8-c369-4324-a7fe-bbebd3f04f87 response_code = 200 uri = /baseboard
26512025-03-07T22:42:49.689ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5956 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 442addf3-a080-4397-bb4a-5554a1b66f79 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
26522025-03-07T22:42:54.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56111
26532025-03-07T22:42:54.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56111 req_id = cf23ca3a-a23e-431c-86e2-23912e355a84 response_code = 200 uri = /v2p
26542025-03-07T22:42:54.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45773
26552025-03-07T22:42:54.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45773 req_id = a20a5ee5-7068-4745-9a00-fd2550ae6a01 response_code = 200 uri = /vpc-routes
26562025-03-07T22:42:54.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39690
26572025-03-07T22:42:54.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39690 req_id = 7604e1ac-4ca1-49db-8a87-d40b91e71d98 response_code = 200 uri = /vpc-routes
26582025-03-07T22:42:54.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26592025-03-07T22:42:54.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45773 req_id = 6b8b05e5-7dce-4931-afa7-9d522d4c8467 response_code = 204 uri = /eip-gateways
26602025-03-07T22:42:54.525ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26612025-03-07T22:42:54.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39690 req_id = bdfe51f3-69a3-4998-9f36-673b3e83184c response_code = 204 uri = /eip-gateways
26622025-03-07T22:42:54.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45773 req_id = 0c8b5580-513a-4ecf-949f-8bc792637a78 response_code = 204 uri = /vpc-routes
26632025-03-07T22:42:54.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58243
26642025-03-07T22:42:54.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58243 req_id = fb6bea20-7e23-40b6-be01-3f5b20af1a8e response_code = 200 uri = /v2p
26652025-03-07T22:42:54.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39690 req_id = 7f9ca9d0-dfe0-4fb3-80e3-23743fea9d54 response_code = 204 uri = /vpc-routes
26662025-03-07T22:42:54.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48877
26672025-03-07T22:42:54.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26682025-03-07T22:42:54.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26692025-03-07T22:42:54.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48877 req_id = 7ba21609-ffd0-4a00-aa70-63435dbc6322 response_code = 204 uri = /switch-ports
26702025-03-07T22:42:54.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37119
26712025-03-07T22:42:54.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26722025-03-07T22:42:54.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48877 req_id = e6a05f34-b969-4ad6-9bed-71df2025a487 response_code = 200 uri = /network-bootstore-config
26732025-03-07T22:42:54.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26742025-03-07T22:42:54.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40255
26752025-03-07T22:42:54.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40255 req_id = 8ebf5b0b-8af9-42c1-afc8-01c5ceb59bed response_code = 200 uri = /vpc-routes
26762025-03-07T22:42:54.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 99417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37119 req_id = 304a87cc-f347-4ad7-b4da-35a00ec8e993 response_code = 204 uri = /switch-ports
26772025-03-07T22:42:54.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37119 req_id = da329920-e691-4470-8692-db541c9afd3d response_code = 200 uri = /network-bootstore-config
26782025-03-07T22:42:54.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26792025-03-07T22:42:54.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40255 req_id = f446e307-96f7-4529-8e2d-ca0659258f04 response_code = 204 uri = /eip-gateways
26802025-03-07T22:42:54.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40255 req_id = 278920d9-a9a0-4c32-8b08-1df2b5ce7101 response_code = 204 uri = /vpc-routes
26812025-03-07T22:42:54.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57272
26822025-03-07T22:42:54.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
26832025-03-07T22:42:54.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
26842025-03-07T22:42:54.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93862 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57272 req_id = 529daf30-5113-4280-a272-7e14233609e2 response_code = 204 uri = /switch-ports
26852025-03-07T22:42:54.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56227
26862025-03-07T22:42:54.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57272 req_id = 3ed63932-e943-4949-8354-c16ba72f64d6 response_code = 200 uri = /network-bootstore-config
26872025-03-07T22:42:54.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56227 req_id = 7d5b0a2b-7f15-49fa-a274-8d9511a98f04 response_code = 200 uri = /v2p
26882025-03-07T22:43:07.784ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49958
26892025-03-07T22:43:07.784ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49958 req_id = 7a3025d4-3c10-4fbf-a319-032966b12349 response_code = 200 uri = /baseboard
26902025-03-07T22:43:19.690ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5671 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 08879176-e84a-411e-af2c-5835577f82d0 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
26912025-03-07T22:43:24.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57987
26922025-03-07T22:43:24.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57987 req_id = be73b0b5-47a5-4918-8948-f09f797674d1 response_code = 200 uri = /vpc-routes
26932025-03-07T22:43:24.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38224
26942025-03-07T22:43:24.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38224 req_id = 208fc404-b67b-4f71-9170-3be9e5571ce5 response_code = 200 uri = /v2p
26952025-03-07T22:43:24.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
26962025-03-07T22:43:24.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57987 req_id = 11b23e92-ab7f-40d7-bdc8-5e685aa2919e response_code = 204 uri = /eip-gateways
26972025-03-07T22:43:24.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57987 req_id = 6aa8f96f-e165-4f44-b415-de95f7d1af0e response_code = 204 uri = /vpc-routes
26982025-03-07T22:43:24.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45258
26992025-03-07T22:43:24.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45258 req_id = 5e735f19-bd3b-4db9-9e35-b82f71ca62a6 response_code = 200 uri = /vpc-routes
27002025-03-07T22:43:24.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
27012025-03-07T22:43:24.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45258 req_id = 369fba0f-0cef-4dfb-9b26-d4efbeea5518 response_code = 204 uri = /eip-gateways
27022025-03-07T22:43:24.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45258 req_id = c115fd9c-6069-4a49-9222-3c25ffa43059 response_code = 204 uri = /vpc-routes
27032025-03-07T22:43:24.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61858
27042025-03-07T22:43:24.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61858 req_id = dd8bf002-e3c0-4c94-b49c-189be752b285 response_code = 200 uri = /v2p
27052025-03-07T22:43:24.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43786
27062025-03-07T22:43:24.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27072025-03-07T22:43:24.522ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27082025-03-07T22:43:24.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123029 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43786 req_id = a50bfaf9-6e31-4759-891b-a7cb5157e9cc response_code = 204 uri = /switch-ports
27092025-03-07T22:43:24.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61990
27102025-03-07T22:43:24.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27112025-03-07T22:43:24.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43786 req_id = 8e49996d-8b05-4f0a-81c0-bd1fbc53a1d3 response_code = 200 uri = /network-bootstore-config
27122025-03-07T22:43:24.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34693
27132025-03-07T22:43:24.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34693 req_id = 7bc0e6c3-a73f-4e27-8f43-f2515c29a9f6 response_code = 200 uri = /vpc-routes
27142025-03-07T22:43:24.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27152025-03-07T22:43:24.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
27162025-03-07T22:43:24.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 631 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34693 req_id = 3ece80b8-0608-4e77-9bd2-5d003b96810e response_code = 204 uri = /eip-gateways
27172025-03-07T22:43:24.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 992 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34693 req_id = 8ea5e42f-9fa7-4091-9c17-f8af25fe9b8f response_code = 204 uri = /vpc-routes
27182025-03-07T22:43:24.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61990 req_id = 6dd4b55e-baa4-4d60-9645-23945c997d5c response_code = 204 uri = /switch-ports
27192025-03-07T22:43:24.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61990 req_id = 5c9eb36f-9a18-4e6a-b514-9eb57e0db906 response_code = 200 uri = /network-bootstore-config
27202025-03-07T22:43:24.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60285
27212025-03-07T22:43:24.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27222025-03-07T22:43:24.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27232025-03-07T22:43:24.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 93824 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60285 req_id = f37966d4-01c9-44e7-8050-855a51e08296 response_code = 204 uri = /switch-ports
27242025-03-07T22:43:24.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42588
27252025-03-07T22:43:24.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60285 req_id = 74ad5cf8-4fd0-4633-bc5b-8cf5a03394d6 response_code = 200 uri = /network-bootstore-config
27262025-03-07T22:43:24.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42588 req_id = 132f9a55-5923-4991-b2eb-ba0420181c44 response_code = 200 uri = /v2p
27272025-03-07T22:43:30.091ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
27282025-03-07T22:43:30.091ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
27292025-03-07T22:43:30.091ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
27302025-03-07T22:43:30.091ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
27312025-03-07T22:43:37.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55653
27322025-03-07T22:43:37.818ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55653 req_id = 9a487a59-e176-4927-a9f6-50ae3cad0592 response_code = 200 uri = /baseboard
27332025-03-07T22:43:49.692ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7511 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 42ba241f-305a-4b6e-bbab-1537a6c6b182 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
27342025-03-07T22:43:54.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55939
27352025-03-07T22:43:54.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55939 req_id = 2602ac36-a432-4584-9ad1-df82d402222f response_code = 200 uri = /vpc-routes
27362025-03-07T22:43:54.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42952
27372025-03-07T22:43:54.453ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27382025-03-07T22:43:54.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42952 req_id = 7ce4b80f-0e78-4f35-81b5-5e91999ad91c response_code = 200 uri = /artifacts
27392025-03-07T22:43:54.513ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
27402025-03-07T22:43:54.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55939 req_id = f15f27a5-927c-483d-ace7-459a9f7e2b4b response_code = 204 uri = /eip-gateways
27412025-03-07T22:43:54.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41033
27422025-03-07T22:43:54.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27432025-03-07T22:43:54.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27442025-03-07T22:43:54.580ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
27452025-03-07T22:43:54.580ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
27462025-03-07T22:43:54.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27472025-03-07T22:43:54.593ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe
27482025-03-07T22:43:54.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48173
27492025-03-07T22:43:54.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48173 req_id = 0b5313b6-6366-471c-92a6-d750ba50d5bb response_code = 200 uri = /vpc-routes
27502025-03-07T22:43:54.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53815
27512025-03-07T22:43:54.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27522025-03-07T22:43:54.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53815 req_id = c50dfad7-2b31-4de5-94ce-0307ab77111f response_code = 200 uri = /artifacts
27532025-03-07T22:43:54.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37760
27542025-03-07T22:43:54.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37760 req_id = 9fcae382-2ee8-4d96-98e6-1cc7a29dfa8a response_code = 200 uri = /v2p
27552025-03-07T22:43:54.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
27562025-03-07T22:43:54.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48173 req_id = 542a3793-cbbb-4deb-ae1b-31876fdc1d54 response_code = 204 uri = /eip-gateways
27572025-03-07T22:43:54.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27582025-03-07T22:43:54.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19
27592025-03-07T22:43:54.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55939 req_id = 3da79c89-defc-4032-ac0b-49d1a5592630 response_code = 204 uri = /vpc-routes
27602025-03-07T22:43:54.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48173 req_id = 3252341a-71f2-402a-b0f7-0852e4a8bda3 response_code = 204 uri = /vpc-routes
27612025-03-07T22:43:54.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59612
27622025-03-07T22:43:54.652ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27632025-03-07T22:43:54.657ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27642025-03-07T22:43:54.658ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07
27652025-03-07T22:43:54.687ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27662025-03-07T22:43:54.688ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f
27672025-03-07T22:43:54.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27682025-03-07T22:43:54.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55807
27692025-03-07T22:43:54.721ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27702025-03-07T22:43:54.721ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4
27712025-03-07T22:43:54.757ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27722025-03-07T22:43:54.757ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550
27732025-03-07T22:43:54.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
27742025-03-07T22:43:54.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59612 req_id = fe74dae2-a5ba-4c1b-80dd-cc85e04129f4 response_code = 204 uri = /switch-ports
27752025-03-07T22:43:54.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 886 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59612 req_id = ad422b49-7ba9-463c-99de-391a99cdb80d response_code = 200 uri = /network-bootstore-config
27762025-03-07T22:43:54.788ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27772025-03-07T22:43:54.788ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6
27782025-03-07T22:43:54.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
27792025-03-07T22:43:54.815ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27802025-03-07T22:43:54.815ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443
27812025-03-07T22:43:54.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64244
27822025-03-07T22:43:54.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35423
27832025-03-07T22:43:54.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46630
27842025-03-07T22:43:54.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46630 req_id = 6f210441-a284-47e9-82d0-f04acae9b546 response_code = 200 uri = /vpc-routes
27852025-03-07T22:43:54.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64244 req_id = c8835011-0583-4d34-b598-cd71007396e2 response_code = 200 uri = /v2p
27862025-03-07T22:43:54.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27872025-03-07T22:43:54.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27882025-03-07T22:43:54.831ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
27892025-03-07T22:43:54.837ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
27902025-03-07T22:43:54.847ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27912025-03-07T22:43:54.848ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a392d7b0-50bb-4de9-a232-eebb50118c53
27922025-03-07T22:43:54.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47018
27932025-03-07T22:43:54.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27942025-03-07T22:43:54.871ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27952025-03-07T22:43:54.871ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe
27962025-03-07T22:43:54.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53727
27972025-03-07T22:43:54.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 298246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41033 req_id = dc0309f8-7673-4868-b461-c66dc82a64d5 response_code = 200 uri = /inventory
27982025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27992025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28002025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28012025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28022025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28032025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28042025-03-07T22:43:54.878ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28052025-03-07T22:43:54.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53727 req_id = 0168455b-fa6f-44b1-a034-b95ef7360d9d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28062025-03-07T22:43:54.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47018 req_id = 8e427141-5fa2-4f2b-ad1e-7af24b2fba78 response_code = 200 uri = /artifacts
28072025-03-07T22:43:54.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
28082025-03-07T22:43:54.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46630 req_id = dd99299f-cb4c-483e-9dee-19c4be153f5a response_code = 204 uri = /eip-gateways
28092025-03-07T22:43:54.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 186424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55807 req_id = 67ab99d4-c7d8-4427-b9c1-5344f135702c response_code = 204 uri = /switch-ports
28102025-03-07T22:43:54.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55807 req_id = 945082e1-9bc1-488b-8c7e-38a871a29f12 response_code = 200 uri = /network-bootstore-config
28112025-03-07T22:43:54.904ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28122025-03-07T22:43:54.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19
28132025-03-07T22:43:54.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46630 req_id = df515e5e-2c58-40c6-9dac-2a6acb5786d4 response_code = 204 uri = /vpc-routes
28142025-03-07T22:43:54.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28152025-03-07T22:43:54.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07
28162025-03-07T22:43:54.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28172025-03-07T22:43:54.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f
28182025-03-07T22:43:54.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28192025-03-07T22:43:54.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4
28202025-03-07T22:43:55.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55659
28212025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28222025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28232025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28242025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28252025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28262025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28272025-03-07T22:43:55.003ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28282025-03-07T22:43:55.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55659 req_id = dfd07aac-f8bc-49c8-9ebb-ea02d0babc65 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28292025-03-07T22:43:55.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54249
28302025-03-07T22:43:55.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28312025-03-07T22:43:55.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28322025-03-07T22:43:55.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/config/omicron-zones.json file = common/src/ledger.rs:175
28332025-03-07T22:43:55.007ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/config/omicron-zones.json file = common/src/ledger.rs:175
28342025-03-07T22:43:55.023ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9fb1b54-30e4-4283-8bc7-944aa88f7bbe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28352025-03-07T22:43:55.024ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f9fb1b54-30e4-4283-8bc7-944aa88f7bbe
28362025-03-07T22:43:55.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62440
28372025-03-07T22:43:55.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28382025-03-07T22:43:55.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28392025-03-07T22:43:55.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550
28402025-03-07T22:43:55.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 67ff492e-fbd3-45b7-b04a-4f700244cb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28412025-03-07T22:43:55.059ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_67ff492e-fbd3-45b7-b04a-4f700244cb19
28422025-03-07T22:43:55.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28432025-03-07T22:43:55.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6
28442025-03-07T22:43:55.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28452025-03-07T22:43:55.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28462025-03-07T22:43:55.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443
28472025-03-07T22:43:55.116ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f5f307d3-def3-4aa0-b8c2-932ec53e3a07 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28482025-03-07T22:43:55.116ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_f5f307d3-def3-4aa0-b8c2-932ec53e3a07
28492025-03-07T22:43:55.135ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28502025-03-07T22:43:55.135ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a392d7b0-50bb-4de9-a232-eebb50118c53
28512025-03-07T22:43:55.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fbbc3af-6edf-46c9-9c16-e7166460652f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28522025-03-07T22:43:55.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_9fbbc3af-6edf-46c9-9c16-e7166460652f
28532025-03-07T22:43:55.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 123605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62440 req_id = c66fcee8-e19f-4789-86a5-9fdac2c261d5 response_code = 204 uri = /switch-ports
28542025-03-07T22:43:55.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39659
28552025-03-07T22:43:55.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62440 req_id = 0d6ee3a9-570c-494b-bd50-66438e8835aa response_code = 200 uri = /network-bootstore-config
28562025-03-07T22:43:55.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39659 req_id = 894ac71a-3837-4e23-83a6-6dc5044ebc6e response_code = 200 uri = /v2p
28572025-03-07T22:43:55.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 348197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35423 req_id = b4643db9-a655-4c6f-ac25-a86ac4dd6bf9 response_code = 200 uri = /inventory
28582025-03-07T22:43:55.185ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 319d4b9c-c11d-4dcb-b9f2-411f83dab9e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28592025-03-07T22:43:55.185ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_319d4b9c-c11d-4dcb-b9f2-411f83dab9e4
28602025-03-07T22:43:55.214ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8997a49a-4139-4f8c-87ca-ee1f29bf1550 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28612025-03-07T22:43:55.214ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_8997a49a-4139-4f8c-87ca-ee1f29bf1550
28622025-03-07T22:43:55.240ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1b19142a-b2ec-4041-a690-ee84f683d7c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28632025-03-07T22:43:55.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_1b19142a-b2ec-4041-a690-ee84f683d7c6
28642025-03-07T22:43:55.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 23444eeb-ffe3-4f9f-acba-28c0cf8ec443 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28652025-03-07T22:43:55.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_23444eeb-ffe3-4f9f-acba-28c0cf8ec443
28662025-03-07T22:43:55.290ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a392d7b0-50bb-4de9-a232-eebb50118c53 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28672025-03-07T22:43:55.290ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1121 request = datasets_list zpool = oxp_a392d7b0-50bb-4de9-a232-eebb50118c53
28682025-03-07T22:43:55.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 300512 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54249 req_id = 4fc1ec51-da68-4a23-99de-e70b4045cda0 response_code = 200 uri = /inventory
28692025-03-07T22:43:55.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60939
28702025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:759 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 00c422b8-3a81-4d2c-bc3f-fc426f6f9897, kind: Service { id: fbf58a59-609b-4fb3-b792-2c09f3f7b776 }, name: Name("external-dns-fbf58a59-609b-4fb3-b792-2c09f3f7b776"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 066589e5-6cdf-4b01-9f39-98f2c968e6c2, kind: Service { id: 732b0e55-5ccf-4068-b771-1299f872f618 }, name: Name("external-dns-732b0e55-5ccf-4068-b771-1299f872f618"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 242])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 867d8023-aff2-4521-891f-07d5f45be915, kind: Service { id: dfe169a3-7536-4b54-9593-8815d6e81dd4 }, name: Name("nexus-dfe169a3-7536-4b54-9593-8815d6e81dd4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8980b304-809c-4233-b9df-dd6e12e7c2f3, kind: Service { id: c0f69897-7f92-43db-ad47-96c3c4721128 }, name: Name("nexus-c0f69897-7f92-43db-ad47-96c3c4721128"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb82146b-41bd-465f-8803-0f44afcd8f6e, kind: Service { id: 0f5c512c-2fda-4cff-bbad-41e8a283d9ff }, name: Name("nexus-0f5c512c-2fda-4cff-bbad-41e8a283d9ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 207])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28712025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28722025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28732025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte0" rules = []
28742025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28752025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28762025-03-07T22:43:55.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:777 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28772025-03-07T22:43:55.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60939 req_id = efef9049-be63-42f3-a361-c75a4deb31ea response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28782025-03-07T22:44:07.851ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38437
28792025-03-07T22:44:07.852ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38437 req_id = 5b22df59-9ebb-4c42-9874-0da7c0863b3d response_code = 200 uri = /baseboard
28802025-03-07T22:44:19.692ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6282 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = eb6f19cf-a28a-47b1-927f-c164579e62c9 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
28812025-03-07T22:44:24.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60784
28822025-03-07T22:44:24.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60784 req_id = 46c3f8b2-5e8a-4a13-aeab-57c608a097a3 response_code = 200 uri = /v2p
28832025-03-07T22:44:24.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50663
28842025-03-07T22:44:24.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50663 req_id = d5703024-ab76-433e-a7d8-d564b86d6620 response_code = 200 uri = /vpc-routes
28852025-03-07T22:44:24.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65063
28862025-03-07T22:44:24.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65063 req_id = 3c01ce09-5aa0-43ca-ada9-983883182338 response_code = 200 uri = /vpc-routes
28872025-03-07T22:44:24.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
28882025-03-07T22:44:24.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65063 req_id = 09df0cab-e44b-4a97-b2e6-3674da21046b response_code = 204 uri = /eip-gateways
28892025-03-07T22:44:24.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65063 req_id = 37cb92de-6f2e-43c1-b766-f1207b80d54e response_code = 204 uri = /vpc-routes
28902025-03-07T22:44:24.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
28912025-03-07T22:44:24.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50663 req_id = bf731a25-ec68-4279-8716-268f8edbef2e response_code = 204 uri = /eip-gateways
28922025-03-07T22:44:24.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52880
28932025-03-07T22:44:24.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
28942025-03-07T22:44:24.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
28952025-03-07T22:44:24.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 134253 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52880 req_id = 588b006f-d6b8-4185-9663-7c97cef92f66 response_code = 204 uri = /switch-ports
28962025-03-07T22:44:24.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60433
28972025-03-07T22:44:24.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48339
28982025-03-07T22:44:24.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52880 req_id = c399ec81-1c27-422e-a54b-69bb27fe3c8e response_code = 200 uri = /network-bootstore-config
28992025-03-07T22:44:24.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60433 req_id = 8c3ad68b-9949-46bf-af03-4bb75fc16069 response_code = 200 uri = /v2p
29002025-03-07T22:44:24.517ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29012025-03-07T22:44:24.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11408 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50663 req_id = 8fd2769d-555f-459a-a3bd-0f1633df6463 response_code = 204 uri = /vpc-routes
29022025-03-07T22:44:24.563ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29032025-03-07T22:44:24.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48339 req_id = c70860c3-85f1-4efe-9ad4-f6cc35c4d5f5 response_code = 204 uri = /switch-ports
29042025-03-07T22:44:24.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48339 req_id = 08ec41a6-8f9f-4e90-b4f7-291ea9e00e19 response_code = 200 uri = /network-bootstore-config
29052025-03-07T22:44:24.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40031
29062025-03-07T22:44:24.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40031 req_id = 906dae21-9cc7-43d0-8927-a9f69a2d8330 response_code = 200 uri = /vpc-routes
29072025-03-07T22:44:24.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
29082025-03-07T22:44:24.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40031 req_id = ebd29314-6725-43e2-bd72-d9fcd6e2a30a response_code = 204 uri = /eip-gateways
29092025-03-07T22:44:24.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32866
29102025-03-07T22:44:24.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32866 req_id = 3228d489-ea9f-46f0-a42a-ec1dfe0860e3 response_code = 200 uri = /v2p
29112025-03-07T22:44:24.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40031 req_id = 24d429b8-6b81-4a4b-bcde-71996504ca02 response_code = 204 uri = /vpc-routes
29122025-03-07T22:44:24.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36050
29132025-03-07T22:44:24.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29142025-03-07T22:44:24.853ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29152025-03-07T22:44:24.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36050 req_id = 8b16d450-294b-4932-bee4-f667536a1fdf response_code = 204 uri = /switch-ports
29162025-03-07T22:44:24.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36050 req_id = 72b21ec3-337c-4288-9a16-bd1d711ea6ba response_code = 200 uri = /network-bootstore-config
29172025-03-07T22:44:30.092ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
29182025-03-07T22:44:30.093ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
29192025-03-07T22:44:30.093ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
29202025-03-07T22:44:30.093ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
29212025-03-07T22:44:37.885ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62401
29222025-03-07T22:44:37.885ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 72 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62401 req_id = b1dcc4f3-4e16-4169-a8d3-c90df8f8ec7c response_code = 200 uri = /baseboard
29232025-03-07T22:44:49.693ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6740 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 5d1cf4d9-ba8a-461b-a44f-d75cf3d109c1 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
29242025-03-07T22:44:54.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44927
29252025-03-07T22:44:54.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44927 req_id = 95ed6410-c6c1-431b-b05d-b42a053112a3 response_code = 200 uri = /vpc-routes
29262025-03-07T22:44:54.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
29272025-03-07T22:44:54.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44927 req_id = 51861991-e27f-47cd-8ea8-cbb590e764af response_code = 204 uri = /eip-gateways
29282025-03-07T22:44:54.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44927 req_id = 9c3068a1-b795-4c77-8898-d4d6c9ca7b05 response_code = 204 uri = /vpc-routes
29292025-03-07T22:44:54.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58760
29302025-03-07T22:44:54.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58760 req_id = 0e98a9d7-d2b3-4389-98c2-a3fe7f55c4c8 response_code = 200 uri = /v2p
29312025-03-07T22:44:54.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52790
29322025-03-07T22:44:54.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52790 req_id = 8f185575-1b9d-492c-a288-1a14a9ec3f77 response_code = 200 uri = /vpc-routes
29332025-03-07T22:44:54.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
29342025-03-07T22:44:54.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52790 req_id = 4718b290-1166-4e32-bc51-029faf86b6c5 response_code = 204 uri = /eip-gateways
29352025-03-07T22:44:54.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52790 req_id = 66b65733-a176-4eaa-b2b8-15468985933c response_code = 204 uri = /vpc-routes
29362025-03-07T22:44:54.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64380
29372025-03-07T22:44:54.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64380 req_id = d8bf682d-41db-4081-ac22-ec5ba58e2bdc response_code = 200 uri = /v2p
29382025-03-07T22:44:54.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58670
29392025-03-07T22:44:54.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29402025-03-07T22:44:54.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29412025-03-07T22:44:54.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 100691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58670 req_id = 7e799a4b-e053-4cd0-956a-228ae627f89d response_code = 204 uri = /switch-ports
29422025-03-07T22:44:54.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49879
29432025-03-07T22:44:54.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38428
29442025-03-07T22:44:54.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38428 req_id = 1bac728b-13f9-43a0-b35d-79b6deaf0d13 response_code = 200 uri = /vpc-routes
29452025-03-07T22:44:54.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29462025-03-07T22:44:54.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58670 req_id = dc315ab6-d943-41a6-bc06-cc6dfb2a3f37 response_code = 200 uri = /network-bootstore-config
29472025-03-07T22:44:54.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
29482025-03-07T22:44:54.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38428 req_id = db32e5da-815b-4c67-9e7a-85d02aa0e16e response_code = 204 uri = /eip-gateways
29492025-03-07T22:44:54.706ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29502025-03-07T22:44:54.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38428 req_id = f6ffedc8-c69e-4b2a-a1c9-f9d48512c7ce response_code = 204 uri = /vpc-routes
29512025-03-07T22:44:54.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 109146 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49879 req_id = bfa72272-c01a-492c-b65e-274d5bca2c19 response_code = 204 uri = /switch-ports
29522025-03-07T22:44:54.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49879 req_id = e361895f-7790-4a53-8698-77bc9281809d response_code = 200 uri = /network-bootstore-config
29532025-03-07T22:44:54.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41527
29542025-03-07T22:44:54.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41527 req_id = f0bba412-40f0-492c-bedf-04fe11880be2 response_code = 200 uri = /v2p
29552025-03-07T22:44:54.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60271
29562025-03-07T22:44:54.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
29572025-03-07T22:44:55.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
29582025-03-07T22:44:55.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 96778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60271 req_id = ca2d2e8f-a603-4d4e-b9bf-c10c95578e58 response_code = 204 uri = /switch-ports
29592025-03-07T22:44:55.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60271 req_id = 3a39ada0-45e7-4a12-aea6-0814b979a845 response_code = 200 uri = /network-bootstore-config
29602025-03-07T22:45:07.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59858
29612025-03-07T22:45:07.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59858 req_id = 64d85523-5104-4ee7-9f43-bc73e2cf5fbd response_code = 200 uri = /baseboard
29622025-03-07T22:45:08.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49906
29632025-03-07T22:45:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49906 req_id = 3f15ea16-4924-4c60-9c58-e43d960ac36b response_code = 200 uri = /v2p
29642025-03-07T22:45:08.590ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(2073255) }
29652025-03-07T22:45:08.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49906 req_id = a35adcff-6161-46e1-b7d8-5839e3895b9e response_code = 204 uri = /v2p
29662025-03-07T22:45:08.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60088
29672025-03-07T22:45:08.680ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2073255))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 370dbcde-0c30-435a-8fb2-58d8230eaddc, slot: 0, read_only: false, vcr_json: .., name: "disk-ca9690fdf6d" }], boot_settings: Some(InstanceBootSettings { order: [370dbcde-0c30-435a-8fb2-58d8230eaddc] }), cloud_init_bytes: Some(..) } instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 metadata = InstanceMetadata { silo_id: ebb5815c-a32b-49c0-a621-3a7cd3eb3452, project_id: 107a88d3-76d7-4966-94ec-e33719cb87ce } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-07T22:45:08.674846758Z }
29682025-03-07T22:45:08.680ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 migration_id = None propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29692025-03-07T22:45:08.680ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1625 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 migration_id = None propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(2073255))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: be157122-2b34-4fd6-9919-1f578494e18f, kind: Instance { id: 831cf520-76c6-431b-a34a-a29e6222f280 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2073255), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 370dbcde-0c30-435a-8fb2-58d8230eaddc, slot: 0, read_only: false, vcr_json: .., name: "disk-ca9690fdf6d" }], boot_settings: Some(InstanceBootSettings { order: [370dbcde-0c30-435a-8fb2-58d8230eaddc] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-03-07T22:45:08.674846758Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29702025-03-07T22:45:08.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5692 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60088 req_id = facdaf9b-f0b4-4602-8359-d88869d42038 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030
29712025-03-07T22:45:08.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48944
29722025-03-07T22:45:08.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48944 req_id = 5f610312-0ea5-4b31-b8d6-f46220f09c97 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030/state
29732025-03-07T22:45:08.793ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:461 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 2073255 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29742025-03-07T22:45:08.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29752025-03-07T22:45:08.834ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030 file = illumos-utils/src/zone.rs:327 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29762025-03-07T22:45:08.858ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030 file = illumos-utils/src/zone.rs:365 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29772025-03-07T22:45:08.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37070
29782025-03-07T22:45:08.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37070 req_id = c4b07dc2-994c-4ae4-a072-a0f0a38d157d response_code = 200 uri = /vpc-routes
29792025-03-07T22:45:08.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {be157122-2b34-4fd6-9919-1f578494e18f: {10.151.1.175: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}, 10.151.1.176: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}}} }
29802025-03-07T22:45:10.318ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29812025-03-07T22:45:10.318ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone file = illumos-utils/src/running_zone.rs:491 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29822025-03-07T22:45:10.496ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 34.126413ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29832025-03-07T22:45:10.541ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 145.982933ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29842025-03-07T22:45:10.714ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 288.09074ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29852025-03-07T22:45:11.017ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 297.249844ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29862025-03-07T22:45:11.330ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 809.549221ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29872025-03-07T22:45:12.151ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 1.37203473s file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29882025-03-07T22:45:13.535ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 1.009342146s file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29892025-03-07T22:45:14.557ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 575.587364ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29902025-03-07T22:45:15.143ZWARNSledAgent (InstanceManager): wait for service svc:/milestone/single-user:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 640.01002ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 zone = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
29912025-03-07T22:45:15.813ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030 file = sled-agent/src/instance.rs:2133 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29922025-03-07T22:45:15.823ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 51.595954ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29932025-03-07T22:45:15.885ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 139.447695ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29942025-03-07T22:45:16.034ZWARNSledAgent (InstanceManager): wait for service svc:/system/illumos/propolis-server:default in zone Some("oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030") failed: Property not found. retry in 217.615515ms file = illumos-utils/src/svc.rs:42 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29952025-03-07T22:45:16.263ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2142 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29962025-03-07T22:45:16.299ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2166 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29972025-03-07T22:45:16.384ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1276 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
29982025-03-07T22:45:16.384ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
29992025-03-07T22:45:16.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7448570 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37070 req_id = f883debf-b342-4d90-8c58-7a3c0ca57b69 response_code = 204 uri = /eip-gateways
30002025-03-07T22:45:16.385ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-03-07T22:45:16.384991541Z } file = sled-agent/src/instance.rs:842 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30012025-03-07T22:45:16.385ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-07T22:45:16.384991541Z } propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30022025-03-07T22:45:16.385ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-07T22:45:16.384991541Z }, migration_in: None, migration_out: None }
30032025-03-07T22:45:16.429ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-03-07T22:45:16.429817750Z } file = sled-agent/src/instance.rs:842 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30042025-03-07T22:45:16.429ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-07T22:45:16.429817750Z } propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30052025-03-07T22:45:16.429ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-07T22:45:16.429817750Z }, migration_in: None, migration_out: None }
30062025-03-07T22:45:16.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37070 req_id = b043ce75-1849-493b-81af-cba3f5c6df41 response_code = 204 uri = /vpc-routes
30072025-03-07T22:45:19.693ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6351 local_addr = [fd00:1122:3344:101::1]:63164 method = GET remote_addr = [fd00:1122:3344:101::d]:49675 req_id = 45854fc6-22e7-49dc-8240-498ac8b3fba5 response_code = 200 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 uri = /73b218dd-7dbc-4345-acb1-fe69ced4a7f7
30082025-03-07T22:45:24.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46162
30092025-03-07T22:45:24.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46162 req_id = b098392a-48b3-4cbb-b81c-5a5a0976a1fd response_code = 200 uri = /vpc-routes
30102025-03-07T22:45:24.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56763
30112025-03-07T22:45:24.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56763 req_id = 42d93e0a-0c72-4c84-98de-4bc448a5ccc9 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030/state
30122025-03-07T22:45:24.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36822
30132025-03-07T22:45:24.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36822 req_id = ce50dcaa-7c8a-4a94-a5c3-3626dd0e326f response_code = 200 uri = /vpc-routes
30142025-03-07T22:45:24.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {be157122-2b34-4fd6-9919-1f578494e18f: {10.151.1.175: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}, 10.151.1.176: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}}} }
30152025-03-07T22:45:24.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46162 req_id = 5954b3d7-1dd5-4279-9831-0846d415937e response_code = 204 uri = /eip-gateways
30162025-03-07T22:45:24.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64256
30172025-03-07T22:45:24.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49227
30182025-03-07T22:45:24.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49227 req_id = 5c89ea47-f53b-48e8-9b2a-76ef1c29c435 response_code = 200 uri = /v2p
30192025-03-07T22:45:24.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64256 req_id = b11603d2-f627-4d12-8b48-58492e83c7a5 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030/state
30202025-03-07T22:45:24.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46162 req_id = 8fbd86d2-167e-4468-9be4-5efbf234bb21 response_code = 204 uri = /vpc-routes
30212025-03-07T22:45:24.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {be157122-2b34-4fd6-9919-1f578494e18f: {10.151.1.176: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}, 10.151.1.175: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}}} }
30222025-03-07T22:45:24.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36822 req_id = 04d3b361-ba63-4a0d-811f-d57de08c6777 response_code = 204 uri = /eip-gateways
30232025-03-07T22:45:24.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51674
30242025-03-07T22:45:24.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
30252025-03-07T22:45:24.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
30262025-03-07T22:45:24.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 127560 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51674 req_id = be0677ac-fe06-4a79-99bd-6cad47aea7cf response_code = 204 uri = /switch-ports
30272025-03-07T22:45:24.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56305
30282025-03-07T22:45:24.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
30292025-03-07T22:45:24.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5482 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36822 req_id = 8ea486a0-adb6-4411-86dc-09b564c9d297 response_code = 204 uri = /vpc-routes
30302025-03-07T22:45:24.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5587 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51674 req_id = ce52c504-e419-4be2-8425-3b096a1d638e response_code = 200 uri = /network-bootstore-config
30312025-03-07T22:45:24.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55201
30322025-03-07T22:45:24.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55201 req_id = c7070ead-b325-4d4c-9a91-c507f114063c response_code = 200 uri = /vpc-routes
30332025-03-07T22:45:24.549ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
30342025-03-07T22:45:24.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38691
30352025-03-07T22:45:24.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56305 req_id = a23e2418-c7eb-4107-b868-3d7c6c5e393a response_code = 204 uri = /switch-ports
30362025-03-07T22:45:24.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56305 req_id = c4323f74-5b41-422d-850b-d354c422b022 response_code = 200 uri = /network-bootstore-config
30372025-03-07T22:45:24.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38691 req_id = cf0ee30a-d10d-4368-be5e-288f69809075 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030/state
30382025-03-07T22:45:24.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39087
30392025-03-07T22:45:24.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39087 req_id = a5a758a1-7356-4a8f-bcc4-7470dbc93caa response_code = 200 uri = /v2p
30402025-03-07T22:45:24.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {be157122-2b34-4fd6-9919-1f578494e18f: {10.151.1.176: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}, 10.151.1.175: {3ada68f0-1bcd-4a51-8fdc-58e69fb3bda1}}} }
30412025-03-07T22:45:24.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55201 req_id = 720d32cb-4f30-43e4-8eb4-cdce3c3bc66d response_code = 204 uri = /eip-gateways
30422025-03-07T22:45:24.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55201 req_id = d3a9c50b-5c10-4994-9307-d579b1e81eee response_code = 204 uri = /vpc-routes
30432025-03-07T22:45:24.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58464
30442025-03-07T22:45:24.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4194
30452025-03-07T22:45:24.757ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4218
30462025-03-07T22:45:24.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 104020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58464 req_id = 0f76bf66-cb7d-4cb8-ba86-750b9c551987 response_code = 204 uri = /switch-ports
30472025-03-07T22:45:24.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58464 req_id = 8b80eea1-9816-490f-ac6c-0d1ee4fe28ad response_code = 200 uri = /network-bootstore-config
30482025-03-07T22:45:24.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41349
30492025-03-07T22:45:24.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41349 req_id = c1674f1c-0637-41f8-9cc4-67b6ef9d5fde response_code = 200 uri = /v2p
30502025-03-07T22:45:26.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38490
30512025-03-07T22:45:26.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38490 req_id = a549fc62-9121-4306-8dc2-70b6b3497884 response_code = 200 uri = /vmms/03cf82ac-c6eb-49ea-9515-bc937b5eb030/state
30522025-03-07T22:45:26.437ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-03-07T22:45:26.437465773Z } file = sled-agent/src/instance.rs:842 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30532025-03-07T22:45:26.437ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-07T22:45:26.437465773Z } propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30542025-03-07T22:45:26.437ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-07T22:45:26.437465773Z }, migration_in: None, migration_out: None }
30552025-03-07T22:45:26.529ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-03-07T22:45:26.529723960Z } file = sled-agent/src/instance.rs:842 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30562025-03-07T22:45:26.529ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:864 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-03-07T22:45:26.529723960Z } propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30572025-03-07T22:45:26.529ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:878 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30582025-03-07T22:45:26.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30592025-03-07T22:45:26.529ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 13222747575819052381 n_samples = 6 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
30602025-03-07T22:45:26.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30612025-03-07T22:45:26.530ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/66abaaaf-daa5-4de4-bd67-09c153a40921/debug/bundle/zone", "/pool/int/9e4c4ae4-c3be-41ae-b347-c365c790c0ce/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f9fb1b54-30e4-4283-8bc7-944aa88f7bbe/crypt/debug", "/pool/ext/67ff492e-fbd3-45b7-b04a-4f700244cb19/crypt/debug", "/pool/ext/f5f307d3-def3-4aa0-b8c2-932ec53e3a07/crypt/debug", "/pool/ext/9fbbc3af-6edf-46c9-9c16-e7166460652f/crypt/debug", "/pool/ext/319d4b9c-c11d-4dcb-b9f2-411f83dab9e4/crypt/debug", "/pool/ext/8997a49a-4139-4f8c-87ca-ee1f29bf1550/crypt/debug", "/pool/ext/1b19142a-b2ec-4041-a690-ee84f683d7c6/crypt/debug", "/pool/ext/23444eeb-ffe3-4f9f-acba-28c0cf8ec443/crypt/debug", "/pool/ext/a392d7b0-50bb-4de9-a232-eebb50118c53/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:361 zone_name = oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030
30622025-03-07T22:45:26.530ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 5508396733438243085 n_samples = 6 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
30632025-03-07T22:45:27.205ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1166 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030", bundle_id: 02133c07-832d-4d08-86fc-7e3e5bf60925 }, time_created: 2025-03-07T22:45:26.530727817Z, version: 0, cause: TerminatedInstance }
30642025-03-07T22:45:27.205ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_03cf82ac-c6eb-49ea-9515-bc937b5eb030 file = sled-agent/src/instance.rs:1376 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30652025-03-07T22:45:28.978ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:281 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30662025-03-07T22:45:28.996ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(2073255), kind: System }
30672025-03-07T22:45:28.996ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:929 id = RouterId { vni: Vni(2073255), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30682025-03-07T22:45:28.996ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-07T22:45:28.996587306Z }, migration_in: None, migration_out: None }
30692025-03-07T22:45:29.019ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:761 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-07T22:45:28.996587306Z }, migration_in: None, migration_out: None }
30702025-03-07T22:45:29.025ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1313 instance_id = 831cf520-76c6-431b-a34a-a29e6222f280 propolis_id = 03cf82ac-c6eb-49ea-9515-bc937b5eb030
30712025-03-07T22:45:29.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34070
30722025-03-07T22:45:29.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34070 req_id = 8e3d1a86-e0d7-4c7e-a71e-a6a31f3c596e response_code = 200 uri = /vpc-routes
30732025-03-07T22:45:29.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
30742025-03-07T22:45:29.484ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1237 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7
30752025-03-07T22:45:29.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34070 req_id = a28b98ef-bb5c-4290-9d4e-9972f1693aeb response_code = 204 uri = /eip-gateways
30762025-03-07T22:45:29.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34070 req_id = 2daee695-28fc-4972-9576-9d3539ff49dc response_code = 204 uri = /vpc-routes
30772025-03-07T22:45:29.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41802
30782025-03-07T22:45:29.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41802 req_id = b7e7f2d6-dcd0-4ec9-839e-d7f7284f38e0 response_code = 200 uri = /v2p
30792025-03-07T22:45:29.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44145
30802025-03-07T22:45:29.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44145 req_id = 676116a2-44f9-4d49-b7be-9abfeb1412ab response_code = 200 uri = /v2p
30812025-03-07T22:45:29.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35814
30822025-03-07T22:45:29.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35814 req_id = cae8ad53-af51-4826-aa59-dbf705dc3759 response_code = 200 uri = /vpc-routes
30832025-03-07T22:45:30.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
30842025-03-07T22:45:30.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35814 req_id = 07868c0f-b091-42ec-8d67-4a589aa0c267 response_code = 204 uri = /eip-gateways
30852025-03-07T22:45:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35814 req_id = af2ae611-db68-47ba-82f7-3b9493f17e11 response_code = 204 uri = /vpc-routes
30862025-03-07T22:45:30.094ZINFOSledAgent (DdmReconciler): attempting to ensure stats are enabled file = sled-agent/src/ddm_reconciler.rs:191
30872025-03-07T22:45:30.094ZINFOSledAgent (DdmReconciler): successfully enabled stats file = sled-agent/src/ddm_reconciler.rs:199
30882025-03-07T22:45:30.094ZINFOSledAgent (DdmReconciler): attempting to list currently-originated prefixes file = sled-agent/src/ddm_reconciler.rs:209
30892025-03-07T22:45:30.094ZINFOSledAgent (DdmReconciler): prefix advertisement reconciliation complete (nothing to advertise or withdraw) file = sled-agent/src/ddm_reconciler.rs:224
30902025-03-07T22:45:30.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59731
30912025-03-07T22:45:30.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59731 req_id = fde0dda3-2fcb-47d6-a3cc-a9c8f74a74d3 response_code = 200 uri = /vpc-routes
30922025-03-07T22:45:30.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1211 sled_id = 73b218dd-7dbc-4345-acb1-fe69ced4a7f7 values = ExternalIpGatewayMap { mappings: {} }
30932025-03-07T22:45:30.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59731 req_id = 989f5a26-9d94-4138-ae1b-5956250fa26c response_code = 204 uri = /eip-gateways
30942025-03-07T22:45:30.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59731 req_id = 3e4a51d8-2f9e-4a3f-b406-26b0c60fb5d9 response_code = 204 uri = /vpc-routes