Taft's battery next served in the Reserve Artillery under Col Hays at the Battle of Fredericksburg. It was one of the batteries lined up overlooking the Rappahannock River to support the federal army's crossing of the river. In the Chancellorsville campaign he served under Cpt William M. Graham and BG Robert O. Tyler. In May 1863 his battery fired across the river not far from where it was positioned in December to cover the crossing of VI Corps at the beginning of the Second Battle of Fredericksburg.