In 1806 he married Susannah Darby, eldest daughter of John Darby of Leap Castle, County Offaly, and his wife Anne Vaughan, and sister of John Nelson Darby, one of the most influential of the early Plymouth Brethren. They had ten children, including Edward, the eldest son and heir; Richard, Auditor General of Ceylon; Ellen, who married James Thomas O'Brien, Bishop of Ossory, Ferns and Leighlin, and Dorothea, (Dora) (1825-1859), who married in 1850, as his second wife, James Stopford, 4th Earl of Courtown, and had three sons. Two of Dora's sons, General Sir Frederick Stopford, commander at the Landing at Suvla Bay, and Admiral Walter Stopford, became famous.