Merging crawled data using syn and ignored