 White was a member of the White political family of Virginia and West Virginia and was the son of John Baker White (1794 – 1862), a grandson of prominent Virginia judge Robert White (1759 – 1831), and a great-nephew of United States House Representative Francis White (1761 – 1826). He was a younger brother of West Virginia Attorney General Robert White (1833 – 1915).
