During the tumultuous reign of Edward II, Talbot was aligned with the enemies of two of the king's favorites, Piers de Gaveston and Hugh Despenser. He was implicated for involvement in Gaveston's murder, but was pardoned. Despite his role in the death of the king's favorite, he was appointed to govern Gloucester Castle in 1317. Talbot joined Thomas of Lancaster in the baronial revolt against Despenser, and was heavily fined when the revolt failed. He was also ordered to surrender the governorship of Gloucester to Despenser.