The city of Babylon in ancient Mesopotamia was where the first New Year's celebrations were recorded about 4,000 years ago.