excludes added to crawler
Major suite 3 bugfix using urllib2.

Added crawler-excludes option.
updated readme
updated changelog
Merge branch 'bugfix/timeout' into development