some work on fixing documentation and writing it for clean and tokenize (not finished)