He scored four times in 38 games in 1998–99, and again Villa won all games in which he found the net, including a 2–1 victory at Coventry City in which Taylor scored both Villa's goals. He was prolific in 1999–2000, scoring ten goals in 42 games, helping Villa to reach the 2000 FA Cup Final, where they lost out 1–0 to Chelsea. Taylor hit five goals in 35 games in 2000–01, including both goals in a 2–0 win over Tottenham Hotspur. However, he was restricted to just eighteen appearances in 2001–02, as manager John Gregory was replaced by Graham Taylor in January. After only nineteen appearances in 2002–03, he was released by Taylor at the end of the campaign.