In 2003 , Stump and his fellow band members went on to sign with Island Records , and released the acoustic-based EP My Heart Will Always Be the B-Side to My Tongue CD and DVD in 2004 to hold fans over while the group recorded their major label debut .
In 2003 , Stump and his band mates went on to sign with Island Records , and released the acoustic-based EP My Heart Will Always Be the B-Side to My Tongue CD and DVD in 2004 .