Lord Somers was twice married. He married as his first wife Margaret, daughter of Reverend Treadway Russell Nash, on 19 March 1785. They had three sons and one daughter. His eldest son, Edward Charles Cocks, a British Army officer, was killed at the Siege of Burgos in 1812 during the Peninsular War.