By the time the 39th was involved in the Siege of Petersburg, Virginia, Allen was a corporal in Company K. When the regiment (as part of the XXIV Corps under Major General John Gibbon) was assaulting Fort Gregg on April 2, 1865, under heavy fire, he was at the front as a color bearer.