Added webcrawler
refactoring