Both water and milk can be used to make cupcakes, but it really does depend on what your lemon cupcake recipe calls for. For example, I use milk rather than water in my lemon cupcakes recipe. Milk helps to provide a richer flavor and moist texture, thanks to the fat and sugar content. This is why you will see milk used in most cupcake recipes rather than water.