The Browns reached the championship game in 1954 and beat the Lions for a second NFL title. Gillom had the league's second-longest punting average for the second year in a row. Another championship followed in 1955. Despite his consistency, Gillom's punting slipped in his last years, and by 1956 he had to compete with rookies for a spot on the roster. At 35, he was Cleveland's oldest player and suffered from a sore back. He made the team but was released toward the end of the season in November. When he left the game, his career punting average of 43.8 yards was the second-best in NFL history behind Sammy Baugh's 45.1 yards. He never averaged below 41.2 yards per punt and was among the top three punters in his league in six of the eight years when he punted full-time. Because his punts were so long and high, opponents' punt returns were limited. He punted more than 400 times from the start of his career before one was returned for a touchdown. He was also a serviceable end, making 43 receptions when he played the position for periods in 1948 and 1949. Brown lauded his diverse abilities, calling him "the best all around athlete I coached at Massillon" and saying he was "successful at everything he did".