Yes, you can swap milk with water or a non-dairy milk. The edges might turn out crispier. Use vegetable oil instead of butter or dairy-free butter to grease the pan.