As the song only features Kylie, she does not appear on the cover sleeve of the single.
Vključeval je glasbo pesmi »Keep On Pumping It Up« glasbene skupine Freestyle Orchestra in vokale iz pesmi »I Guess I Like It like That« Kylie Minogue.