The minority of the fort walls were removed in what decade?