Updated soaf submodule to latest.
Updated ignore list.
Added dryrun option for crawler.crawl(). Wrapped base url in Link
container. Passing url stack to on_loop() hook.
Fixed project template.
Fixed some warnings and exceptions. Added count parameter for dry runs.
Fixed bug where dry run would actually save to the database.
Added path normalization for DefaultUrlHandler.
Fixed bug where url/referrer were mixed up in relative paths.
Fixed bug where complete URL was sent instead of path, causing issues on
some servers.
Added options to convert extracted element from XPath to string and to
strip HTML tags.
Merge pull request #1 from overridelogic/upstream

Merged from upstream.