Moving crawler code into a crawler directory. Added a indexer directory for indexer code.