Tgi Bench
💻
Hugo Larcher
hlarcher
AI & ML interests
None yet
Recent Activity
updated
a Space
1 day ago
hlarcher/tgi-bench
published
a Space
1 day ago
hlarcher/tgi-bench
updated
a model
6 days ago
hlarcher/xet-bench
Organizations
hlarcher's activity
updated
a
Space
1 day ago
published
a
Space
1 day ago
updated
a
model
6 days ago
published
a
model
6 days ago
reacted to
fdaudens's
post with 🔥
22 days ago
Post
1794
🔥The Open R1 team just dropped OlympicCoder and it's wild:
- 7B model outperforms Claude 3.7 Sonnet on IOI benchmark (yes, 7B!!)
- 32B crushes all open-weight models tested, even those 100x larger 🤯
Open-sourcing the future of code reasoning! 🚀
Check it out https://huggingface.co/blog/open-r1/update-3
- 7B model outperforms Claude 3.7 Sonnet on IOI benchmark (yes, 7B!!)
- 32B crushes all open-weight models tested, even those 100x larger 🤯
Open-sourcing the future of code reasoning! 🚀
Check it out https://huggingface.co/blog/open-r1/update-3
updated
a
model
about 1 month ago
published
a
model
about 1 month ago
updated
a
model
about 1 month ago
published
a
model
about 1 month ago
updated
a
dataset
about 2 months ago
published
a
dataset
about 2 months ago
upvoted
an
article
about 2 months ago
Article
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
•
55
authored
a
paper
about 2 months ago
upvoted
an
article
2 months ago
Article
Welcome to Inference Providers on the Hub 🔥
•
456
posted
an
update
3 months ago
Post
1091
We are introducing multi-backend support in Hugging Face Text Generation Inference!
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
Check out the details: https://huggingface.co/blog/tgi-multi-backend
upvoted
an
article
3 months ago
Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
By
and 1 other
•
•
71
published
an
article
3 months ago
Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
By
and 1 other
•
•
71
updated
2
datasets
3 months ago
updated
a
dataset
4 months ago