Yes, the person you unfriended will be erased from your chat list. However, they'll still be able to see their conversation with you in their chat list and contact you.