Quant for the community
#1
by
Yhyu13
- opened
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
This model has rank#1 among other Yi-34B variations, may be consider quantize it?
LoneStriker has just uploaded several exl2 quants
Models should show up here when completed, a couple more quant levels to go as of this writing:
https://huggingface.co/models?search=lonestriker%20sus-chat