Yes! Milk will result in a creamier oatmeal texture, but solely using water is an acceptable alternative. For this recipe, you would omit the milk and use 2 cups of water.