If you don't have milk, don't worry! You can substitute sour cream, half and half, heavy cream, or even plain yogurt as a substitute for milk in mashed potatoes. If using a thicker dairy product and the potatoes look a little too thick you can use a little water and/or broth to thin out the potatoes.