If you are trekking through the tour operator then they will provide the filter drinking water. The entire guest house also provides safe drinking mineral water in bottles which will cost you. Normally the guest house uses tap water to cook and prepare tea after boiling. Many international travelers also use tap water with some iodine, drops, and tablets. So it depends on you and your budget on how you like to drink.