Added a test for the #fragment when parsing urls.
Tickets #20 and #30.
Fixed a bug in the Spider + added a lot more logging.