Yes, you can use nut milk as a substitute for dairy milk to make the loaf dairy-free. Almond milk, cashew milk, or soy milk are viable options. Be mindful of the fat content difference, as this might affect the loaf's density.