In 1321, the barons who rebelled against King Edward III of England during the Despenser War took control of the castle but by the mid 14th century, the castle had lost most of its strategic importance again due to the Black Death and it was largely forgotten about by the 15th century.