You can. However, the frosting won't be as rich, creamy, or light and fluffy with milk.