Absolutely! The skin of a sweet potato gives texture and flavor to an otherwise one-dimensional bite. It also contains a good portion of the fiber and vitamins in a potato. If you skip the skin you miss out on nutrients, a wonderfully chewy and crispy texture, and a rich, earthy flavor.