In 1851 the 23-year-old Sylvis married 15-year-old Amelia A. Thomas. The union ultimately produced three sons, who were named after contemporary heroes — Henry Clay Sylvis, Oliver Perry Sylvis, and Lewis Clark Sylvis. Following his wife's death in 1865, Sylvis remarried; he ultimately fathered a total of five children.