The House of the Rising Sun
"Gypsy" uses a ballad form. The music has a Middle Eastern feel. The rhythm alternates between double-time and triple time. "Rolling Stone Magazine" critic Stephen Holden describes these rhythms as "driving and excited" and describes the guitar textures as "exotic." The instrumentation also includes saxophone and piano. "Irish Times" critic Stewart Parker suggested that the chord progressions of "Gypsy" resemble those of "The House of the Rising Sun."