Revert "Fix assert failure due to signed/unsigned char mismatch"

This reverts commit a1d0fe39d488f2376b76b6b2d0a81f29b1b61dcc.

It's a total mess! I can't understand their logic on choosing signed vs.
unsigned char. I guess I'd better off not touching this at all.