merge changes to track external links
Think I found the culprit - @opts not being sent as hash
Wooh boy. Code was working, but it froze during a complicated crawl, investigating options / issues from github
Imported performance increases from https://github.com/chriskite/anemone/pull/70
Speedy, super quick and reliable logging of all internal links and external links. Stops when it needs to with :force_threading . This particular fork didn't update it's tests, but since I've grouped together code from about 5 different repos, Ill need to write quite a few tests to guarantee performance
Added openmosix' commit which adds options to mongodb; allows for preservation of data & changing db collection names. Commit#: 03162fc00c999a4386399b6e450385cde5c645f4