Backport PR #4668: Make non-ASCII docstring unicode

We shouldn't have non-ascii characters in a bytes literal. This seems to be the source of problems for the docs build on ShiningPanda.

Merging straight away, just making a PR so there's a record of this.