GitHub repository: novastar53/wordpiece-rs
Primary language: Python
Created: 2025-02-05T15:44:03Z
Description: A fast WordPiece tokenizer implementation in Rust with Python bindings