The majority of the fort walls were removed in what decade?