When he was sixteen Lee followed McGowan and served with the Confederate Army during the Civil War, although there is no official record of his service; however, he was photographed armed and in the uniform of McGowan's regiment, the 14th South Carolina Infantry. Lee claimed that he was wounded twice during the course of the war: once at Second Manassas, where McGowan was also wounded, and then again at the Battle of Hanover.