Born the fourth son of Walter Montagu Douglas Scott, 5th Duke of Buccleuch, Charles Montagu Douglas Scott was educated at Radley College and joined the Royal Navy in 1853. He saw service in the Black Sea in 1855 during the Crimean War. He also took part in the Battle of Fatshan Creek in 1857 during the Second Opium War and served with the Naval Brigade during the Indian Mutiny of 1857.