Old Lodge itself had been built for , and thus frequented by Britain 's first prime minister , Sir Robert Walpole , who hunted at the estate and said that he could '' do more business there than he could in town '' .
Old Lodge itself had been built by George II for Britain 's first prime minister , Sir Robert Walpole , who frequented it , particularly to hunt at the estate . 
 Walpole said that he could '' do more business there ( Old Lodge ) than he could in town '' .