Educated at Cheltenham College, Baker was commissioned into the 18th (Royal Irish) Regiment in 1854. He served in the Crimean War and was present at the Siege of Sevastapol. He was involved in suppressing the Indian Mutiny in 1857.