At the age of 15, Hoynes enlisted as a Private in Company A of the 20th Wisconsin Volunteer Infantry Regiment during the American Civil War. He was wounded during the Battle of Prairie Grove, Arkansas and was discharged in November 1863. He then enlisted in Company D of the 2nd Regiment Wisconsin Volunteer Cavalry in February 1864 and remained with that unit through the remainder of the war.