In October 1321 King Edward and his troops besieged Leeds Castle, after the governor's wife, Margaret de Clare, Baroness Badlesmere, refused Queen Isabella admittance and subsequently ordered her archers to fire upon Isabella and her escort after the latter attempted to gain entry to the castle. Elizabeth, the third Badlesmere daughter, was married to Joan and Mortimer's eldest son, Edmund. King Edward exploited his new popularity in the wake of his military victory at Leeds to recall to England the Despensers, whom the Lords Ordainers, led by Thomas, 2nd Earl of Lancaster, had forced him to banish in August 1321. The Marcher lords, already in a state of insurrection for some time prior to the Despensers' banishment, immediately rose up against the King in full force, with Mortimer leading the confederation alongside Ordainer Humphrey de Bohun, 4th Earl of Hereford. The King quelled the rebellion, which is also known as the Despenser War; Mortimer and his uncle Roger Mortimer de Chirk both surrendered to him at Shrewsbury on 22 January 1322. Mortimer and his uncle were dispatched as prisoners to the Tower of London, where they were kept in damp, unhealthy quarters. This was likely a factor in Roger Mortimer de Chirk's death in 1326. Joan's husband had fared better; by drugging the constable and the Tower guards, he managed to escape to France on 1 August 1323. It was there that he later became the lover of Queen Isabella, who was estranged from the King as a result of the Despensers' absolute control over him. She had been sent to France on a peace mission by Edward but used the occasion to seek help from her brother, Charles IV to oust the Despensers. The scandal of their love affair forced them to leave the French court for Flanders, where they obtained help for an invasion of England.