The water in Florence is drinkable and safe. They even have a water fill-up fountain in the Piazza Della Signoria.