I do not recommend leaving the skin on the potatoes unless you're using a potato with really thin skin like red, white or Yukon Gold Potatoes. If the skin doesn't completely disintegrate during cooking, it will not be as appealing. Take the time, peel the potatoes!