scrapy/scrapy — pull request #502 by kmike (2013-12-28 00:34:49+00:00)
Title: [MRG] DOWNLOAD_DELAY docs clarification

* delay is enforced per website, not per spider;
* document `download_delay` attribute (it was previously documented only in FAQ about 999 error codes);
* document how `CONCURRENT_REQUESTS_PER_IP` affects download delays.

I'm not sure `CONCURRENT_REQUESTS_PER_IP` is an intended feature; I got an idea that it works this way by reading https://github.com/scrapy/scrapy/blob/master/scrapy/core/downloader/__init__.py.