Error running with TGI using docker image
1
#6 opened 9 months ago
by
jhaile317
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64fa1237fd212fdfdeddf576/8LiVEgEkXYXmbdHy9R_pL.jpeg)
Quant pls
1
#5 opened 9 months ago
by
Yhyu13
Use with VLLM Now - https://github.com/0-hero/vllm-mixtral
1
#4 opened 9 months ago
by
0-hero
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6382255fcae34727b9cc149e/PYiwi8LVZParYvImmcGez.png)
What transformers version are you using?
3
#2 opened 9 months ago
by
Promptengineering