but the small fortress would be abandoned and destroyed over the centuries