Yi-6B-gptq-4bit / README.md
bnjmnmarie's picture
Update README.md
6dfe5ff verified
---
language:
- en
- zh
library_name: transformers
tags:
- auto-gptq
---
## Model Details
This is 01-ai/Yi-6B quantized and serialized with AutoGPTQ in 4-bit.
Details here:
[Yi: Fine-tune and Run One the Best Bilingual LLMs on Your Computer](https://kaitchup.substack.com/p/yi-fine-tune-and-run-one-the-best)
- **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
- **Language(s) (NLP):** English
- **License:** [yi-license](https://huggingface.co/01-ai/Yi-6B/blob/main/LICENSE) https://huggingface.co/01-ai/Yi-6B/blob/main/LICENSE