Soon after his marriage, Somerset proceeded to the Cape Colony, where his father was governor, and served with the Cape Mounted Rifles throughout the Xhosa Wars. On 25 March 1823, he was made major, and on 17 July 1824, lieutenant-colonel. In 1834, he was made a Knight of the Royal Guelphic Order, and later a Companion of the Bath.