It depends on the potato and your personal preference. Since gold potatoes have very thin skin, I do not peel them. However, when I’ve made this soup with russet potatoes, I have peeled them because their peels are thicker.