New England fishermen knew Shelburne as "Port Roseway" and frequently used the outer harbour for seasonal shelter and repairs. Pirate Ned Low raided the New England fishing fleet at Shelburne Harbour in 1723, capturing 13 ships and taking Philip Ashton captive. After the forced expulsion of the Acadians in 1755, there were no European settlers for several decades. Alexander McNutt attempted to start a settlement in 1765 but was not successful.