Text2Text Generation
Transformers
GGUF
101 languages
t5
text-generation-inference

Load the model with python

#1
by katebsaber - opened

Thank you for sharing quantized versions. I was wondering if we could load them in python?

I don't know of any python libraries that support quantized t5 models but if I find one, I'll let you know and also add an example to the readme!

Sign up or log in to comment