The Confederates under Lt. Gen. James Longstreet attempted to recapture Suffolk and Norfolk but after besieging the fortified Union forces from April 11, 1863, to May 3, 1863, the Confederates retired. Brig. Gen. Henry Dwight Terry now commanded the brigade and on April 17, 1863, he sent 6 companies of the 130th New York Infantry out to determine why the Confederates had ceased firing. When the Confederates resumed fire, the regiment lost one killed and five wounded. The Confederates broke off the siege on May 3, 1863. The brigade took part in Maj. Gen. Erasmus Keyes's abortive Peninsular Campaign toward Richmond between June 13, 1863, and July 12, 1863, while the Army of Northern Virginia was engaged in the Gettysburg Campaign.