Bledsoe's Battery saw no more action until April 7, 1863, when it was part of a small skirmish at Thomas's Plantation, Mississippi. After that action, Bledsoe's Battery became part of Brigadier General John Gregg's brigade, with which the battery was briefly stationed at Port Hudson, Louisiana. Meanwhile, Grant had landed a Union force at Bruinsburg, Mississippi in late April. After defeating Brigadier General John S. Bowen's division at the Battle of Port Gibson, Grant began moving his army towards Jackson, Mississippi. In response, Gregg's brigade was sent from Port Hudson to Jackson via Osyka. After arriving in Jackson, the brigade was sent by Lieutenant General John C. Pemberton to Raymond to scout Grant's movements. On May 12, contact was made between Gregg's men and those of Union Major General James B. McPherson, bringing on the Battle of Raymond. At the beginning of the battle, Bledsoe's Battery and its three cannons, along with the 1st Tennessee Infantry Battalion, occupied a position that gave the battery a clear field of fire towards a bridge over Fourteenmile Creek. When Union infantry neared the creek, Bledsoe's Battery opened fire, drawing return fire from the 8th Michigan Battery. Later in the battle, one of the battery's guns overheated and exploded. After Union pressure broke Gregg's left, Gregg disengaged and retreated towards Jackson. The next day, the Confederates entered the defenses of Jackson. Bledsoe's Battery had been the only Confederate artillery unit present at the Battle of Raymond. On May 14, the battery was present at the Battle of Jackson as part of General Joseph E. Johnston's army, but was only lightly engaged.