Yes. There are trains, busses, boats going to the Old City area and they work until midnight. It is also easy for you to go around the city with all the transportation options you have.