Following off-season surgery, Carter only managed 43 games during the 2002–03 season. In February 2003, Carter gave up his starting spot in the 2003 NBA All-Star Game to Michael Jordan to allow Jordan to make his final start as an All-Star. Carter played in 73 games during the 2003–04 season, but the Raptors fell three games short of making the playoffs.