Yes. Water is extremely important for milk production. A good rule of thumb to follow is aiming to drink .5 ounces of water for each pound you weigh. You’ll need to drink additional water beyond this while nursing. Drink to satisfy your thirst in order to stay hydrated.