Yep, you'll be fine if you drink the water in Amsterdam. I've been to Amsterdam more times than most and I've never had a single issue after gulping gallons of the stuff. If you're worried though, you can always opt to drink bottled water.