Remodelling of the structure began in 1762. King William thought about converting the palace into what after a fire destroyed the Palace of Westminster in 1834