Research interests

Maintainers of the `huggingface/text-generation-inference` repo

Team members 4

Organization Card
About org cards

Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power LLMs api-inference widgets.

Check out the source code 👉

models

None public yet

datasets

None public yet