There are three points that you can't return to once you've progressed through the story. Make use of your map's legend to complete the missions & challenges before proceeding.