Albert began his career at South Kirkby before joining neighbours Barnsley for £50. After just one season at Oakwell Albert was sold by Barnsley to Sunderland in April 1908 for the then maximum transfer fee of £350, Albert made his debut on 9 September 1908 in a 3–0 win against Middlesbrough at Ayresome Park. Though Albert played for The Black Cats from 1908 to 1914, he never won a League Championship, as in the 1912–13 season he was injured and missed the majority of the title claim, as well as the 1913 FA Cup Final defeat to Aston Villa. Overall for Sunderland, he made 123 league appearances without a goal. In March 1914 Albert was given a benefit game by the Black Cats before he joined Swindon Town in May of the same year. Despite the transfer fee paid by Swindon being "a very large one" after just twelve months he left the club to return to the Sunderland area with the onset of war.