Yes, you should soak sweet potatoes before baking. Soaking sliced sweet potatoes before baking will release surface starches. Releasing surface starches helps to crisp the potatoes on the outside, resulting in a deliciously crispy potato.