A left half, Low began his senior career with Northern League club Aberdeen and was a part of the club's rise from the Northern League to the Scottish League First Division during the early years of the 20th century. He made 114 appearances and scored 30 goals during four seasons at Pittodrie and transferred to English First Division club Sunderland for a £400 fee in May 1907. Low played eight seasons for Sunderland, before the suspension of league football in 1915 (following the outbreak of the First World War) ended his competitive career with the club. During his time at Roker Park, Low made 228 appearances, scored 38 goals and was a part of the squad which won the 1912–13 First Division championship and reached the 1913 FA Cup Final.