In 1780, "Panther" returned to England and was then attached for a year to Sir Samuel Hood's fleet in the West Indies. Returning to England early in 1782, Harvey was transferred to the new 64-gun ship and in her returned to the Mediterranean, again distinguishing himself at the relief of Gibraltar and the subsequent Battle of Cape Spartel. At the war's conclusion the following year, Harvey retained his active career due to his excellent records and served in several shore appointments, including regulating captain at Deal and commander of the guardship at Sheerness.