Puerto Rico and its barrier islands in the Caribbean Sea, like Isla de Culebra and Vieques, can be visited without a passport.
You can also visit the US Virgin Islands, like St. Thomas, St. Croix, and St. John, without a passport for classic Caribbean vibes and beautiful beaches.