added methods for creating inverted index
updated crawlers to use inverted index