Everything costs money. While the costs are significant, the money spent will regenerate parts of cities, create an image of the host country as a place for business, and create a long lasting legacy through the venues and infrastructure built.  While South Africa is not rich as the UK, Greece or Australia, its GDP per capita is around that of Brazil, which is hosting the 2016 Games.