Speed up unicode support.

- Remove uneeded import
- Remove uneeded if statement