The White Tower, which gives the entire castle its name, was built by William the Conqueror, Duke of Normandy in 1078.