"Held Up Without a Gun" is a track from "The River" sessions that began a Springsteen tradition of using songs that did not appear on his albums as B-sides. A River Tour performance of it is included on "The Essential Bruce Springsteen" compilation album's optional disc. This was the only live performance of the song in a regular Springsteen concert (apart from rehearsals) until the song reappeared twice during the Magic tour and once during the Wrecking Ball Tour. The studio version remained unavailable on CD until the release of 2015 box set "".