Murphy made his debut in a 1–0 defeat away to Blackpool on 5 March 1930 and played one further league game during his first season. In the following season, 1930–31, West Bromwich Albion won the FA Cup and promotion from the Second Division, but Murphy had yet to establish himself in the team and again made just two appearances. He became a regular in the Albion side upon the club's return to the First Division; from 1931–32 to 1934–35 he appeared 149 times in league and cup, helping his team to achieve four consecutive top ten finishes, including fourth place in 1932–33. The 1934–35 season saw Murphy miss just one match all season, and he helped Albion to reach the 1935 FA Cup Final, which they lost 4–2 to Sheffield Wednesday.