Lindsay was born on February 19, 1837 in North Hudson, New York. During the American Civil War, he was an officer with the 118th New York Volunteer Infantry of the Union Army. Conflicts he took part in include the Battle of Drewry's Bluff, the Battle of Chaffin's Farm and the Siege of Petersburg. Afterwards, Lindsay settled in Neillsville, Wisconsin.