iParadigms/walker — pull request #115 by pchristopher1275 (2014-12-16 21:27:56+00:00)
Title: This patch corrects the TRN-130 pathology and passes all tests.

Original ticket
The current logic in the dispatcher has something like:
refreshDecimal := walker.Config.Dispatcher.RefreshPercentage / 100.0
idealCrawled := round(refreshDecimal * float64(numRemain))
idealUncrawled := numRemain - idealCrawled

for i := 0; i < idealUncrawled && len(uncrawledLinks) > 0 && len(links) < limit; i++ {
links = append(links, uncrawledLinks[0])
uncrawledLinks = uncrawledLinks[1:]
}
But it seems like this will cause us to crawl exclusively Uncrawled links if idealUncrawled is 0. There may be other boundary issues here.

More conversation can be found on JIRA https://jira2.iparadigms.com/browse/TRN-130