Maintainers of the `huggingface/text-generation-inference` repo
Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power LLMs api-inference widgets.