Set base url for all threads, check if url matches base url
Modified test
Delete frontier directory on start up.
Merge branch 'master' of https://github.com/mackinnond/crawler4j