In 1961, Defense Secretary Robert McNamara recruited Vance to become General Counsel of the Department of Defense. He was then made the Secretary of the Army by President John F. Kennedy. He was Secretary when Army units were sent to northern Mississippi in 1962 to protect James Meredith and ensure that the court-ordered integration of the University of Mississippi took place.