You will not need a passport to go to Puerto Rico or the U.S. Virgin Islands, but you will need one to go to the other Caribbean islands such as The Bahamas or St. Baths.