cformers (pypi): SoTA Transformers with C-backend for fast inference on your CPU.
Keywords: python|local inference|c++ inference|language models|cpu inference|quantization