Fix bug where outer walls were being demolished