merging both crawlers