He remained with the club until June 1983, when he moved to Bradford City on a free transfer. Withe spent more than four years with City, missing just one game when they won the Football League Division Three title in 1984–85. On the last day of that successful season his day was to turn into a nightmare when 56 spectators were killed in a horrendous stand fire while playing Lincoln City. He moved on for £50,000 to Notts County in October 1987, playing regularly before joining Bury in July 1989. He had a loan spell with Chester City in October 1990 and then moved to Mansfield Town in January 1991.