Somerset served as an aide-de-camp to his uncle, Lord Raglan, during the Crimean War. He fought at the Alma, Balaclava, and Inkermann. At Inkermann, his horse was killed under him by a shell. He served at the Siege of Sevastopol and was made a CB for his Crimean services in 1855, as well as a Knight of the Order of the Medjidie, 4th Class.