In the 1951–52 season, the club finished in 8th place, their lowest since promotion, but Walker won a second FA Cup, 1–0 against third-placed Arsenal in the final. However he began to find his chances limited and Stan Seymour sold him to Oldham in February 1954.