GitHub repository: ztjhz/word-piece-tokenizer
Primary language: Python
Created: 2022-09-24T16:21:41Z
Description: A Lightweight Word Piece Tokenizer