adding manual crawler and indexer
Merge branch 'master' of https://github.com/profmugshot/group17