In the spring of 1954, the Calgary Stampeders sought to lure Stanfel to the Canadian Football League with an offer to pay 20% more than his $7,000 salary with the Lions. Stanfel instead signed a new contract with the Lions in May 1954 for an estimated salary of $8,500. After a strong start to the 1954 season, Stanfel missed the last five games of the regular season with a back injury. In Stanfel's absence, the Lions lost to the Bears and played the Eagles to a tie. Stanfel returned to the lineup days before the NFL Championship Game. At the time of Stanfel's return, Lions head coach Buddy Parker called him "the best blocking back in the NFL." The 1954 Lions compiled a 9–2–1 record and won the NFL Western Conference championship before losing to the Browns in the 1954 NFL Championship Game. For the second consecutive season, Stanfel was selected as a first-team All-NFL player by both the AP and UP.