Question: is it safe to drink water from upstairs tap?
Answer: As long as it comes from the tap, and the water in general is safe, there is no reason not to drink from the sink or shower.