addition of populating crawl dictionary function and related test case