The building at the core of Hamilton Palace was a 13th-century tower house known variously as 'The Orchard' or the 'Castle of Hamilton', which was the seat of the Hamilton family. The earliest reference to a castle at Hamilton is in a charter of 1445, when James Hamilton was created first Lord Hamilton. When the palace was demolished in the 1920s, the remains of walls up to thick (compared to elsewhere in the building), were discovered in the north-west quarter, clearly indicating the defensive nature of the medieval core of the palace. In 1451 the medieval parish church of Hamilton (which stood to the east of the later palace) was promoted to collegial status by Lord Hamilton. 'The Orchard' was the object of much destructive attention on the part of royal armies in the period between 1565 and 1579, suffering damage in a siege of 1570 during the Marian civil war due to James Hamilton, Duke of Châtellerault's support for Mary, Queen of Scots. The castle was damaged again in 1579 on the occasion when Cadzow Castle was destroyed and left abandoned. It accommodated King James VI on a hunting trip in 1589. 'The Orchard' was rebuilt and enlarged in 1591 on a quadrangular plan and named the 'Palace'.