fastt5 (pypi): boost inference speed of T5 models by 5x & reduce the model size by 3x using fastT5.
Keywords: T5|ONNX|onnxruntime|NLP|transformer|quantization|generate text|summarization|translation|q&a|qg|machine learning|inference|fast inference|deep-learning|fast|fastt5|inference-speed|nlp|onnx|python|pytorch|quantized-onnx-models|question-answering|t5