TokenIterator: allow calling the scan method from inheritors
Merge pull request #1267 from HosipLan/feature/extensible-tokenizer

TokenIterator: allow calling the scan method from inheritors