Yes, you can make the casserole with just milk if you prefer. However, the heavy cream adds richness and a creamy texture to the dish, so I would highly recommend using it if possible.