Remodelling of the structure began in 1762. What was George IV's original plan for the house?