With the Phillies, he continued his role as a reliable relief pitcher, earning his second career All-Star nod in his first season in Philadelphia, though he did not appear in the game. After finishing second to the Pirates in 1975, McGraw's Phillies won their division crown the next three seasons. They were, however, unable to reach the World Series as they were swept by Cincinnati's "Big Red Machine" in the 1976 NLCS, and fell to the Los Angeles Dodgers the following two seasons.