new working based code tokenizer