There was another castle on this site, and you can see the outline of its walls in the courtyard.