mobiuslabsgmbh
/

Llama-2-7b-chat-hf_2bitgs8_hqq

Text Generation

Model card Files Files and versions Community

mobicham commited on Mar 27

Commit

b2bcfdf

•

1 Parent(s): eaae4c2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ inference: false
 pipeline_tag: text-generation
 ---
-This is an experimental <a href="https://github.com/mobiusml/hqq/">HQQ</a> 2-bit quantized <a href="https://huggingface.co/meta-llama/Llama-2-7b-chat-hf"> Llama2-7B-chat model </a> using a low-rank adapter to improve the performance (referred to as HQQ+).
 Quantizing small models at extreme low-bits is a challenging task. The purpose of this model is to show the community what to expect when fine-tuning such models.
 We notice that, when given more specialized data, the low-bit model can even outperform the full-precision model at some tasks.

 pipeline_tag: text-generation
 ---
+This is an experimental <a href="https://github.com/mobiusml/hqq/">HQQ</a> 2-bit quantized <a href="https://huggingface.co/meta-llama/Llama-2-7b-chat-hf"> Llama2-7B-chat model </a> using a low-rank adapter to improve the performance (referred to as <a href="https://mobiusml.github.io/1bit_blog/">HQQ+</a>).
 Quantizing small models at extreme low-bits is a challenging task. The purpose of this model is to show the community what to expect when fine-tuning such models.
 We notice that, when given more specialized data, the low-bit model can even outperform the full-precision model at some tasks.