A tree or clouds can keep a baby happy for hours. I guarantee that you will enjoy these first trips without making big plans. I found breast feeding made camping much more simple than bottle feedings ever would have been. Pre made formula is expensive - but sterile. Powders are convenient but can be hard to mix at a campground faucets.
Some campgrounds have questionable water sources.
For more information on water click here. The biggest concern is keeping prepared formula cold. Keeping bottles clean can be a real pain. I suggest Playtex Nursers with the disposable liners.