Tokenizer integration tests; finish unit test coverage (closes #7)