Ross reconsidered and released Beanes. Skinner, Key and Beanes were allowed return to the "Minden". However, they could not sail back to Baltimore, but were held offshore from Fort McHenry until the outcome of the Battle of Baltimore was decided. The trio had learned too much about British forces and their plans to attack on Baltimore to be allowed to go free. The "Minden" was tied to a British ship in the Chesapeake Bay and guarded by British soldiers until after the battle. It began the morning of September 13, 1814, and the three men watched it from their ship. There was a large flag at Fort McHenry visible to them, however, smoke from British gunfire, cannons, Congreve rockets and nightfall eventually obscured it from their view.