ecdeveloper/node-web-crawler — pull request #8 by josephdpurcell (2013-07-22 19:22:53+00:00)
Title: Better handling for scraping links, i.e. relative urls and whitespace.

I was having a terrible time trying to scrape some websites. I discovered this was due to the fact that the site has TERRIBLE links, i.e. whitespace and relative urls that don't begin with a forward slash. I really don't like this code, but at least it works. If someone has time in the future, it would be great to refactor it to use the "url" library.