Fixed Null Pointer Exception spot
Removed redirect flags
All exceptions now go to Logger
Added the Type of Tag from which the URL is taken
Commit
Changed visibility for use methods
Added Listener for RobotTxt Disallow
Bug fixes
Merge pull request #2 from declum/new-listener-framework

Closing the branch