site dupe done, site new and site search now strip index entries if they dont exist