Yes, on your profile, tap on the highlight where the story you want to delete is saved. Open it and tap the dots, and select delete from the menu.