Possibly the first house erected within the site was that of a Sir William Blake, around 1624. Which owner developed none of the garden still seen today?