Improve how duplicate sites are filtered.