It's best not to drink tap water in Malaysia. Only drink bottled water that's factory sealed to avoid water-borne illnesses. Use bottled or sterilized water for brushing teeth too. Ice at restaurants is generally safe if the establishment caters to tourists.