Hugging Face's logo

zgce
/
Synatra-7B-v0.3-RP-3.5bpw-hb6-exl2

Text Generation
Transformers
mistral
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

这是为显存过小的显卡做的模型，使用exllamav2加载器

Downloads last month
2
Inference API
Text Generation
Examples
Input a message to start chatting with zgce/Synatra-7B-v0.3-RP-3.5bpw-hb6-exl2.
This model can be loaded on Inference API (serverless).