The song had peaked at number ten in the UK and number fifteen in her native Australia, where it was certificated gold by the Australian Recording Industry of Australia, selling over 35,000 copies.
Pesem »Please Stay« je dance-pop pesem zmernega tempa, ki se od ostalih pesmi z albuma razlikuje zaradi zrelejše latino pop glasbe in je edina pesem Kylie Minogue z bolj latino slogom.