To leave a private story, tap and hold your finger on the story and a popup will appear. Now tap on Story Settings>Leave Private Story.