He joined West Ham United in 1922 for a fee of £300. Initially joining as an outside-left, he was moved to the opposite flank to accommodate Jimmy Ruffell. The 1922–23 season saw Richards make 34 Second Division appearances. He also made 10 cup appearances for the club, including the 1923 FA Cup Final loss to Bolton Wanderers. The following season, after promotion to the First Division, Richards made a further ten appearances, including a single FA Cup appearance that saw the Hammers bow out of the competition to Second Division Leeds United. Richards picked up more international caps, playing at inside-left, at the 1923–24 British Home Championship, which saw victories for Wales against all three other teams.