Born in Scoonie, Scott moved with his family to Glasgow at a young age and found work with Cowlairs Railway Works. Initially playing for local sides Towerhill and Northern, Scott was signed by Cowlairs in 1882, before moving to Hearts in 1889. On joining the club, professionalism in Scottish football remained theoretically illegal, and "almost without exception, the players were working at a trade they had." Nevertheless, Hearts had begun to offer their team unofficial compensation, and "it is related [of Scott] that at one time when the treasury was low he offered, of his own accord, to accept less money," while continuing to play. In his early cup-ties, Scott "was always famous for his grit." During his tenure, Hearts won two Scottish Cups and came top of the League in 1894/95. In the 1890/91 and 1892/93 Seasons, Scott was top goal scorer for Hearts. By 1897, Scott was one of the oldest players in the League, along with James Kelly. "One of the marvels" of the Hearts side, Geordie Scott still appeared "endowed with all his old vigour and cleverness [...] and should the first eleven require a change on the left wing the Hearts would do worse than try the old Towerhill player." That year, Scott was briefly loaned to Kilmarnock to play in the Cup Quarter Final against Third Lanark. Following this, Scott formally retired from football, but came back to play in a 1902 charity match between Cowlairs and Northern for the Ibrox Fund.