added copy method to item
Merge pull request #290 from nramirezuy/item-copy

added copy method to item
deleted unused import
Merge pull request #292 from nramirezuy/item-unusedimport

deleted unused import
ported code to use queuelib
Merge pull request #77 from shane42/master

Cookie handling performance improvement
rfc2965 is dead

- It is not enabled by default in python cookielib
- Mozilla rejected implementing it https://bugzilla.mozilla.org/show_bug.cgi?id=208985
- Netscape cookies still rules
- It was superseded by RFC6265 which is the facto protocol formalized
cookies: increase candidate list with dot prefixed domains
fix broken doctests
remove scrapyd doc, as it was moved to its own repo
bind mockserver to 0.0.0.0, to listen on all 127.* range (useful for testing broad crawls)
Add garbage collector to downloader

This fixes a couple of issues:
- reactor callLater leaks when using download delay (test was
  re-enabled)
- downloader slot leaking on broad crawls (slots were created but never
  removed)
Merge pull request #297 from scrapy/downloader-gc

Add garbage collector to downloader
removed obsolete (and broken) downloader method: is_idle()
mention crawlera in best practices, as a way to deal with bans
Use twisted.web.client.Agent for download requests (use of HTTP/1.1)

Adds http11.HttpDownloadHandler in scrapy.core.downloader.handlers
Renamed downloader to Http11DownloadHandler and some refactoring

Only for HTTP, not HTTPS
Test on expected body length instead of request method (HEAD case)
Restore handling of HTTPS
http11 cleanup
add http connection pool and custom ssl context factory