请问加载这个模型要多少GPU?我24000+的提示out of memory
#10 opened about 7 hours ago
by
zyc1128
Request: DOI
4
#9 opened 24 days ago
by
luxen1234
没有在线体验的demo吗?
4
#8 opened about 1 month ago
by
jansen-liu
请问能否提供EXL2量化版本?
1
#7 opened about 1 month ago
by
Orion-zhen
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63e2453cf0740bec2bfd3b23/sxRDL7jMKSKOZV3iFpxGs.jpeg)
能不能提供awq或gptq量化模型
5
#6 opened about 1 month ago
by
bujido
请问能提供GPTQ-Int8版本吗?
4
#5 opened about 1 month ago
by
worldggg
Can you provide the Q5_k_s.gguf model? Thank you.
#4 opened about 1 month ago
by
juexing2024
perfect!!!
2
#3 opened about 1 month ago
by
bluestarry