scrapy/scrapy — pull request #91 by japerk (2012-02-18 01:15:43+00:00)
Title: downloader middleware for http digest authentication

I've tested & used this successfully with HttpAuthMiddleware disabled