added manual crawler and changed jaccard code