Yes, you can drink water right after changing the filter, but you might need to prime the filter first. This is usually done by flushing the filter under running water or soaking it in water. Check the user manual if you're unsure.