Leaving the skins on is perfectly fine and is a personal taste preference. The skins will add a bit more texture and fiber.