The potatoes will help thicken the soup some, but if you find it's still too thin, try adding a cornstarch slurry. Mix 1 tablespoon of cornstarch with 2 tablespoons of water and add it to the soup. Stir while simmering and it should thicken.