It’s not recommended to drink tap water in Cuba.
It’s best to stick to bottles or get yourself a water bottle with a filter.