 A journalist from the Liverpool Daily Post characterised "Push the Button" as "another edgy stomper" and said that it capitalises on the Sugababes'"streetwise credentials and individual vocal strengths". Observer Music Monthly described the song's lyrics as "perfect pop" and recognised it as one of 2005's best singles. The song is a "ray of melodic sunshine" according to Rafael Behr of The Observer, who lauded its catchiness. Jerusalem Post critic Harry Rubenstein described "Push the Button" as an "infectious Abba-esque soundscape". Paul Taylor from the Manchester Evening News called it one the album's best moments and highlighted Austin's contribution. A writer for Virgin Media praised his production of the song, in addition to its chorus, but criticised the Sugababes' performance as "lacklustre".
