At the start of the American Civil War, Bunn enlisted in the 72nd Pennsylvania Infantry. On June 29, 1862, during the Battle of Savage's Station, he was wounded and captured by Confederate forces. Bunn was held as a prisoner of war in Richmond, Virginia until his release during a prisoner exchange later that year. Upon his return to Philadelphia, Bunn experienced a relapse of problems from his wound and received a medical discharge.