On 14 March 2002, Liverpool were fined £20,000 by The Football Association for having made an illegal approach for Ziege when he had been at Middlesbrough. The player himself was fined £10,000. Whilst at Spurs he scored in the 2002 Football League Cup Final but he ended up on the losing side. However, by this time Ziege's injury problems were escalating, and by 2004 his contract was terminated by mutual consent so he could return to Germany.