Eating potatoes with their skin on is generally healthier because the skin contains a good amount of the potato's fiber and several other nutrients. However, make sure to wash the skin thoroughly to remove any dirt or pesticides.