Milman was commissioned into the 5th Regiment of Foot on 24 May 1839. As a captain he saw action as a member of the advance guard in the first relief of Lucknow in September 1857 during the Indian Rebellion. In retirement became major of the Tower of London in 1870 and colonel of the Northumberland Fusiliers in 1899.