relevance/tarantula — Issue #26: Timeout reports queue length as crawled count
Author: rmg
Created: 2012-03-10 07:16:57+00:00
State: open

When a crawl times out, the messages report the number of links found, not the number of links actually crawled.

30 of 651 links completed
Exceeded crawl timeout of 15 seconds - skipping to the next crawl...
Crawled 651 links and forms.

https://github.com/relevance/tarantula/blob/master/lib/relevance/tarantula/crawler.rb#L229

Looks like it should be using `links_comleted_count` instead of `total_links_count`