scrapy/w3lib — pull request #3 by dangra (2012-02-28 16:37:14+00:00)
Title: Encoding detection for empty body

Don't fail accessing first byte of empty bodies looking for BOM

(also reuse to_unicode function in html_to_unicode and add tests for it)