Bullis was wounded and captured at the Battle of Harpers Ferry (September 12–15, 1862). During the Battle of Gettysburg (July 1–3, 1863), he was wounded and captured again. He then was imprisoned for 10 months at the brutal Libby Prison in Virginia until he was exchanged for a Confederate soldier in the spring of 1864.