transformer-smaller-training-vocab (pypi): Temporary remove unused tokens during training to save ram and speed.
Keywords: python|transformer-encoder|transformers