He became popular with fans when he scored in his second game for the club – against North East rivals Sunderland. Queudrue impressed enough to earn a permanent move in May 2002 for a fee of £2.5 million. However, he was also recognised for his poor disciplinary record. His five yellow and three red cards in the 2002–03 season contributed hugely to Middlesbrough missing out on a place in the UEFA Cup through the fair play league – although, conversely, he was a major reason they were high enough up the league to be in contention. He was part of the Middlesbrough side, who beat Bolton Wanderers to win the 2004 League Cup final. He also started for Middlesbrough in the 2006 UEFA Cup Final which they lost 4–0 to Sevilla in Eindhoven.