Yes, you can definitely eat the skin of baked sweet potatoes. It's rich in nutrients and adds texture to the dish. Just make sure to wash and scrub the sweet potatoes thoroughly before baking.