6
🔥
Text Generation Inference
Research interests
Maintainers of the `huggingface/text-generation-inference` repo
Team members 4
Organization Card
About org cards
Text-Generation-Inference is a Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power LLMs api-inference widgets.
Check out the source code 👉
- the server backend: https://github.com/huggingface/text-generation-inference
- the Chat UI: https://huggingface.co/spaces/text-generation-inference/chat-ui
spaces
2
models
None public yet
datasets
None public yet