Restructure things to operate on lists of tokens

Super nasty hack code.
Add tf-idf. Still need to wire up results.