tokenization-layer (pypi): An NLP tokenization algorithm that is a trainable layer for neural networks.
Keywords: natural-language-processing|research|neural-networks|tokenization|tensorflow2