Between his stints as manager, Weaver served as a color commentator for ABC television, calling the 1983 World Series (which the Orioles won) along with Al Michaels and Howard Cosell. Weaver was the lead ABC color commentator in 1983 (replacing Don Drysdale, who moved over to secondary play-by-play for ABC) but was also employed by the Baltimore Orioles as a consultant. At the time, ABC had a policy preventing an announcer who was employed by a team from working games involving that team. So, whenever the Orioles were on the primary ABC game, Weaver worked the backup game. This policy forced Weaver to resign from the Orioles consulting position in October so that he can work the World Series for ABC. Weaver later called the 1984 National League Championship Series (between the San Diego Padres and Chicago Cubs) for ABC alongside fellow hall of famers Reggie Jackson, who played for Weaver in 1976, and Don Drysdale.