Set the charset for binary, but not for UTF-8 (fixes #668)