In 1777, then a colonel, Browne wrote to the English government of his discontent at serving under the authority of two brigadier generals "who have never seen a Shot fired", seeking promotion to major general. He was instead promoted to the rank of brigadier general himself, remaining in that rank for the duration of his service. Browne formed the Loyalist Prince of Wales' American Regiment, served at the siege of Rhode Island, and spent some time in Florida before finally returning to the Bahamas to resume his post there in July 1778. He then faced accusations of cowardice and incompetence for his conduct of the battle and, after dismissing his council in an attempt to scotch the rumours (an unprecedented move), he was replaced by John Robert Maxwell two years later in 1780.