Following his success in 1906 Pilgrim never won a major competition. At the 1908 Summer Olympics he failed to reach the final of the 400 m event. He worked the rest of his career at NYAC, where he served as Athletic Director from 1914 to 1953.