That really depends on the type of soup you'd like to make. Potato skins are edible, so you can leave them on. However, they will start to fall off after cooking and add a papery texture and brown pieces to your soup. For a smoother consistency, I recommend peeling your potatoes completely. Especially for recipes like this slow cooker loaded potato soup, this extra step adds a bright white appearance that is really appetizing.