Stewart fought at the battles of Rocky Face Ridge, Resaca, and New Hope Church, commanding a division in John Bell Hood's corps of Joseph E. Johnston's Army of Tennessee early in the Atlanta Campaign in 1864. Stewart was then assigned command of the Third Corps, replacing William Loring who had assumed temporary command in June for the Battle of Kennesaw Mountain after Polk was killed by artillery on Pine Mountain just two weeks prior. He was appointed temporary Lieutenant General on June 23, 1864. Stewart next took part in the Battle of Peachtree Creek, taking possession of the home of Georgia's Quartermaster General, Ira Roe Foster, as his headquarters. Georgia Historical Commission marker 060-90, erected at that location, states: "Site of the Ira R. Foster house which was occupied as headquarters by Gen. A. P. Stewart, [CSA] during military operations N. of Atlanta, July 16–21, 1864. From here were issued the orders directing his troops in the Battle of Peachtree Creek, July 20." Stewart led the Third Corps at the Battle of Ezra Church, where he was wounded in the forehead on July 28.