Fernie, who was born in Kinglassie, Fife, joined Celtic from his local side Kinglassie Hearts in 1948. He had to wait until March 1950, however, to make his first team debut. Fernie became a regular first team player in 1952–53, and set up both of the Celtic goals in their 2–0 win against Hibs in the Coronation Cup Final.