DanMcInerney/xsscrapy — pull request #15 by ddworken (2014-10-11 15:22:45+00:00)
Title: Added rate limiting. 

Added rate limiting in the form of a -r or --rate flag to set the number of requests per minute (using http://doc.scrapy.org/en/latest/topics/settings.html#download-delay). Changed something.com to example.com to comply with RFC 2606 (http://tools.ietf.org/html/rfc2606#page-2).