If you have already started a conversation, unlinking will not affect you and you will continue to match the same characters.