The tap water across Croatia is generally safe to drink, and you should be fine filling up bottles from taps during your time there.