ekalinin/robots.js — pull request #6 by bingalls-compete (2013-01-09 19:01:09+00:00)
Title: Allow ports in redirect locations

If a site responds with a 301 or 302, and the location has a port number (e.g. http://testsite.com:80/anotherrobots.txt), this will now not crash.