Pollard's father was an English trader, whose headquarters appear to have been at Fort Niagara, and his mother was Seneca. His stepmother was Catherine Montour. As a young man, he participated in the American Revolutionary War and was present at the Battle of Wyoming. He converted to Christianity as a result of the Seneca mission.