Playing college football for Louisiana State University (LSU), Taylor led the Southeastern Conference (SEC) in scoring in 1956 and 1957 and earned first-team All-America honors as a senior. He was selected by the Packers in the second round of the 1958 NFL Draft and was used sparingly as a rookie, but with the arrival of coach Vince Lombardi in 1959 Taylor soon became the team's all-purpose back, especially when only a few yards were needed. In this role, his spirited performance against the Giants in the 1962 NFL Championship Game came to define his mental and physical toughness.