Starting unit tests for tokenizer.
Fixed up readme