Perry returned to the Army of Northern Virginia to command his brigade for the Bristoe Campaign in the fall of 1863. He was severely wounded in the fighting at the Wilderness on May 6, 1864. He briefly returned to the trenches during the Siege of Petersburg, but had not recovered sufficiently for active duty. Hence, he was sent to Alabama for the duration of the war, serving on reserve duty in the Confederate Invalid Corps.