Refactored Crawler. Added Indexer.