Generate a correct and concise answer for the question based on the words in the context.

Context : James Chatham Duane (June 10, 1824 -- December 8, 1897) was an engineering officer in the Union Army during the American Civil War, being the Chief Engineer of the Army of the Potomac.
Question : With which military branch did James Chatham Duane serve with?
Union Army