Unicode all the things

Some things broke after moving away from unicode_literals, let's fix them again.