Always check the website of the park that you’ll be camping at. Most, but not all, campgrounds have a water source like a spigot that can be used to fill up your water bottles.
Look online or call the park ranger service to check for specifics about your campground. You should also always plan to bring a filtered water bottle in case you get stuck somewhere without potable water. A LifeStraw is also an extremely good idea.