Milk adds both moisture and fat, so I do not recommend skipping it. You can, however, use heavy cream, half-and-half, or plant-based milk if you prefer.