Holzmann was inspired by the Battle of Manila Bay during the Spanish–American War, when a command to American sailors to open fire on the Spanish fleet was reputedly met with the response "Well boys, let's blaze away" by the gunners. Building on the war fever in the United States, the cover of the sheet music featured an image resembling Theodore Roosevelt charging at San Juan Hill. Very popular as a two-step, its success outlasted the war and it became a repertoire piece amongst military bands around the world.