Richardson joined Sunderland in 1912 and played there for two years, scoring a total of 31 goals over 45 appearances. In his first season with Sunderland he helped them win the league for the first time since the 1894–95 season and the last time until the 1935–36 season. He also played in the 1913 FA Cup Final against Aston Villa, with Sunderland losing 1–0.