You can, but we like to leave it on. Not only is the skin a good source of nutrients, but it also helps provide a thick, crispy crust to hold the potato wedges together.