@dangra, not sure about what's your idea. Kindly update PR yourself.


2013/11/20 Daniel Graña <notifications@github.com>

> In scrapy/utils/response.py:
>
> >          return obj.body_as_unicode() if unicode else obj.body
> > +    elif isinstance(obj, Response):
> > +        body = obj.body
> > +        if isinstance(body, str):
> > +            return body.decode('utf-8') if unicode else body
> > +        return body if unicode else body.encode('utf-8')
>
> @llonchj <https://github.com/llonchj> : Do you want to update this PR or
> should I take care of it?
>
> it should move body_or_str as private function to scrapy.utils.iteratorsand try to decode "binary" responses using
> utf-8 as best effort.
>
> —
> Reply to this email directly or view it on GitHub<https://github.com/scrapy/scrapy/pull/462/files#r7770963>
> .
>