He played on the unprecedented three consecutive championship teams at Green Bay, which include the 1965 NFL championship, Super Bowl I (led the team with 7 tackles), and Super Bowl II. Caffey played in the legendary Ice Bowl in 1967 and is credited with making 3 tackles for a loss, forcing a fumble, and accounted for the Packers' only sack by dumping Don Meredith for a 9-yard loss; then spilling running backs Dan Reeves and Craig Baynham for 4- and 3-yard losses. Caffey was named AP and UPI All-Pro in . Caffey made his only Pro Bowl appearance following the 1965 season. In 2006, Caffey and fellow linebackers Dave Robinson and Ray Nitschke were named one of the top 10 best linebacking trios in the history of the NFL. Caffey wore #60 as a Packer.