returneksibir/yakala — Issue #22: Invalid extracted links
Author: rimbi
Created: 2011-10-13 18:33:00+00:00
State: open

I have encountered this error on Idefix spider outputs. Some of the links seem to be incorrect. The problem is that the valid link is ,let's say, as follows:

http://idefix.com/....X4I

but it's somehow kept in lower case in the application as follws:

http://idefix.com/....x4i

And because of that link becomes invalid.

I'm not sure if the link is invalid on page or we make it invalid by transforming to lower case letters (That's possible beacuse the links might be being transformed to lower case letters during the checking of already visited links in order to prevent the comparison of links from failing because of the case difference in the link)