You shouldn't drink the tap water in Bangkok and all of Thailand unfiltered. So it is better to use bottled water or a reliable water filter.