Added instructions in crawling and indexing