mobiuslabsgmbh
/

Llama-2-70b-hf-2bit_g16_s128-HQQ

Text Generation

Model card Files Files and versions Community

mobicham commited on Nov 25, 2023

Commit

27c52c4

•

1 Parent(s): 1f1ab9d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ This model outperforms an fp16 LLama-2-13B (perplexity 4.13 vs. 4.63) for a comp
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python
-from hqq.models.llama import LlamaHQQ
 import transformers
 model_id = 'mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ'

 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python
+from hqq.models.llama_hf import LlamaHQQ
 import transformers
 model_id = 'mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ'