Yes, you can delete a private story at any time. Simply access the story settings and choose the delete option.