Lord Byron stayed in the house behind the trees