Added many crawlers, refactored