Ord was the son of Henry Gough Ord and grandson of Craven Ord (1756–1832) of Greenstead Hall, Essex, a prominent antiquarian. He was educated at the Royal Military Academy at Woolwich, (1835–1837). He served in the Royal Engineers, (1837–1856), principally in the West Indies, West Africa, and the Anglo-French expedition to the Baltic (1854), during the Crimean War.