Generally yes, you can drink water from the tap in most places. If you’re in a remote spot, there may be a sign saying ‘not for drinking’. Bottled water is readily available either way.