Water given to babies to drink should be boiled to make it germ free. if using a stovetop kettle or pot, boil water until it comes to a rolling boil, this is when the water does not stop boiling if stirred. Cool the boiled water to a safe temperature before giving it to your baby to drink.