If the notification is related to a direct message or a comment, it might come back if someone adds a new message or comment to the thread.