verifies correct tokenization for all source files in the project