Fix EOF problem in Tokenizer::set_position.

- add call clear method
- add problem to unit test