Added Comments
Improvements/Documentations
Javadoc added for need places.
Improvements
Improvements
Some improvements. And now all exceptions go to Logger
Lunch Script and Export Script
Ignore Logs dir
Changes
Now while seeding also. The URLs will be filtered.
Filter now applied for SuccessLister too for skipping the URLs which are
rejected by our URL Filters.
Scripts and Filters updated.
Commit of Migration of Keys
Commit of Migration of Keys
Commit
Commit
Added Referred_in fields to Document
Updates
Added Listener for RobotTxt Disallow
Bug Rectified