Williams was drafted in the 16th round (222nd overall) of the 1964 NFL Draft by the Cleveland Browns, where he played from 1964 to 1966, and won the 1964 NFL Championship Game. After a contract dispute with the Browns in 1967, he was traded to the New York Giants in 1967 for a draft selection, but was released a few weeks later. Williams was then signed by the Washington Redskins, where he played in 1967. He also played for the Baltimore Colts and the Pittsburgh Steelers.