BUG http/https switching results in an exception
BUG Output the correct url when hitting a > 399 url
NEW: Limit the number of urls to crawl
NEW: Add the possibility to exclude URLs from being scraped
NEW Use the pagetype from the schema when importing
Merge pull request #9 from stojg/master

A bunch of improvements on the static site connector