Water can replace milk in almost all baking recipes. For the best results, add a teaspoon of butter or oil for every cup of milk you are replacing with water. With this said, note that milk makes baked goods taste much better.