Iceland has some of the cleanest drinking water in the world so, yes, it is safe to drink.