Although nothing bad would happen if you drink it, the official statement is that tap water in Greece is not drinkable. That is why you should buy bottled water, which is quite cheap when purchased in bulk (six bottles each).