After graduating from high school in Alabama, Herring enrolled at Auburn in 1942 before quitting to serve in the military during World War II. He returned in 1946 and played football at Auburn through the 1948 season, when he was team captain and was named an All-Southeastern Conference (SEC) player by sportswriters. After graduating in 1949, he joined the Bills and played there one season before the AAFC dissolved. The Browns then selected him in a special dispersal draft created to reassign team-less former AAFC players. He was an occasional starter at linebacker in Cleveland for three seasons. The Browns won the NFL championship in his first year and reached the title game but lost in his second and third years.