[Contacts] Fix listener logical bugs