Yes, you can use water or non-dairy milk instead. However, it may slightly change the texture of your cake.