Provan was a product of the Rangers youth team and played as a full back. He made his debut on 27 December 1958, in a league match away to Third Lanark which Rangers won 3-2. He helped the club win a domestic treble in 1963–64 and played in the 1967 European Cup Winners' Cup Final, which Rangers lost 1–0 to Bayern Munich. Provan is one of the players elected to Rangers' Hall of Fame.