Born in Atlanta, Georgia, Metcalfe grew up in Chicago and graduated high school from Tilden Tech in 1930. He accepted a track scholarship to Marquette University in Milwaukee, Wisconsin, and equaled the record of 10.3 seconds in the 100 m on a number of occasions, as well as equaling the 200 m record of 20.6 seconds. He became the first man to win the NCAA 200 m title three times consecutively. At the 1932 Summer Olympics in Los Angeles, he virtually dead-heated with his rival Eddie Tolan, with the gold medal awarded to Tolan only after extended study of the photograph; both recorded a time of 10.38 seconds in the 100 meters. Metcalfe also earned a bronze medal at these games, in the 200 meters. He competed again at the 1936 Summer Olympics in Berlin, and again took silver in the 100 meters, this time behind four-time gold medalist Owens. They won gold in the 4×100 meter relay with Foy Draper and Frank Wykoff; the U.S. won by 1.1 seconds over runner-up Italy, and Germany took bronze. Fierce rivals on the track, Metcalfe and Owens (1913–1980) became lifelong friends.