You can leave the skins on if you prefer. You will have a slightly different soup style, and the skins will give a chunkier texture. We wouldn’t advise keeping the skins on if you want to blend the soup to a completely smooth consistency.