Large number of fixes-

Renamed WebPageParser to WebPageCrawl - substantially modified, now uses tika for all parsing.
Removed ParseRobotsTXT and replaces with RobotsTXT, uses factories for caching.
Fixed obvious problems in mapreduce for ingest, added TODO's for harder fixes.
Added embedded UI runner based on Jetty for UI.
Fixed references to thinkgeek.com in tests
Fixed references to developer's home directory in tests.
New readme file.
Removed unused domain whitelisting code.
Changes search to look for a default properties.conf in the classpath
root instead of a class-relative location.
Removed old readme.txt
pig and guice were in the pom twice
Merge pull request #1 from medined/dmedinets_fix_double_dependency_inclusion

pig and guice were in the pom twice
Merge branch 'master' of https://github.com/booz-allen-hamilton/bahdit