Remove duplicate contacts caused by linked records

Loading contacts without filtering against the default source means you get duplicate contacts sometimes. This change only includes the first matching version of linked contacts when loading contacts.