If using russet potatoes then the answer is yes. Russet potatoes (baking potatoes) have much thicker skin than red or yellow potatoes and will result in chewy skins throughout the soup that many people will find to be unpleasant. Red and yellow potatoes have much thinner skin that once cooked, becomes virtually unnoticeable. You can choose to peel these potato skins or leave them on.