Born into a family with naval and parliamentary connections, Phipps integrated them both into a short career. He promoted to his first commands during the American War of Independence, commanding a range of small ships off the North American coast and being active against American shipping. He spent the later part of the wars in European waters, commanding frigates, and supporting the fleets. He took part in the first relief of Gibraltar in 1781, and the second in 1782. By then he was captain of a 74-gun ship of the line. He retired ashore after the war, and having embarked on a political career, represented both Scarborough and Minehead before his death at a relatively young age, in 1786.