CollectedContacts: avoid retrying loading the db indefinitely