After a leave of absence, Closson served as XIX Corps chief of artillery from October 1863 to July 1864. He took part in the Red River campaign of March to May 1864, including the Battle of Mansfield on April 8, 1864, Battle of Pleasant Hill on April 9, 1864 and Battle of Monett's Ferry on April 23, 1864.