GitHub repository: yukio808/text2token
Primary language: JavaScript
Description: break down a corpus of text into lines and tokens