removed old tokenize code
Added comments