enhanced tokenizer
abstracter and enhancements on tokenizers