The hillside down from the Rock seems to have been the site of a town, or a load of outbuildings. You can't really see it here, but there's a lot of old stone foundations / basements dug into the hillside.