WebCrawler Changes
- Significantly changed web crawler algorithm for efficiency.
- Removed parseAllDocuments() and moved work performed directly inside WebCrawler class instead of PageParser
- Removed foundNewURL variable
- Removed unnecessary outer while loop

Changes in KeyWord class
- Removed average() method and field 'avgHits'
- slight changes to equals method that takes care of lower and uppercases

Changes in PageAnalyzer
- Implemented functionality

Changes in PageParser
- removed pareAllDocuments()