Add tests for OffsiteMiddleware() + use re.escape() in domains regexp
BaseSgmlLinkExtractor: Fixed unknown_endtag() so that it only set current_link=None when the end tag match the opening tag
BaseSgmlLinkExtractor: Added unit test of a link with an inner tag
BaseSgmlLinkExtractor: Fixed the missing space when the link has an inner tag
AjaxCrawlableMiddleware
add an undocumented setting for lookup body size
Fail-fast path.

For me middleware now can process about 2-3k ajax crawlable pages/sec and 50k+ regular pages/sec (if they don’t contain «fragment» or «content» words).
extra test
AjaxCrawlableMiddleware in Broad Crawl docs
kill AjaxCrawlableMiddlewar.enabled_setting
add a remark about 1%
documentation code example correction corrections per pablohoffman
support showing subclassing deprecation warning only once
revert warning filter on deprecated class instantiation
only warn on direct subclasses of the deprecated class
split subclassing tests and default to warning only once per deprecated class
allow deprecation of a class with custom metaclass
allow overriding old and new class paths
allow deprecation of subclasses of already deprecated classes
test_command_deploy, test_contrib_linkextractors