The weird taste could be due to the water being left too long, or the water tank is dirty. To get rid of the odd water taste, you may clean the water tank and replace a new water bottle.