Absolutely not! The red potato skins are actually quite thin and will cook nicely in the soup. Leaving the skin on also provides structure for the potatoes if you choose to leave the pieces whole.