add token types and some ideas as how to read the whole thing