Upon the surrender of Vicksburg, he marched with Maj. Gen. William T. Sherman to Jackson, Mississippi, and defeated the Confederates at the battle of Jackson. Welsh contracted a malarial fever during this campaign, from which he died in Cincinnati, Ohio, on August 14, 1863. He was buried in Mount Bethel Cemetery in his native Columbia.