You can offer up to 2 to 8 ounces of water in a day. Let them take sips from their cup throughout the day, but make sure you offer plenty of breast milk or formula.