Not using a source filter causes duplicate contacts

The last change I made removed the source filter that was keeping linked contacts out of the database. 

With this new change we still get contacts that don't have an entry in the default source but we keep the duplicates caused by linked contacts out of the database.