Yes, you can replace the plant milk in the recipe with water if you prefer. The glaze can be made with milk or water with good results.