Yes, you do need a passport to go to Point Roberts. While it is physically located in the United States, Point Roberts is isolated from the rest of the country and is only accessible by crossing into Canada or flying into a small airport on the peninsula.