Each sweet potato will vary in how long it takes to bake them, depending on their size. The longer it bakes, the more tender the interior will get. It will be hard to over-bake them unless you completely forget about them in the oven.