casperhansen
/

mistral-7b-instruct-v0.1-awq

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

casperhansen commited on Sep 27, 2023

Commit

1403ab7

•

1 Parent(s): 4e449ff

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ license: apache-2.0
 # Mistral 7B Instruct
-AWQ quantized model.
 Dependencies:

 # Mistral 7B Instruct
+AWQ quantized model using https://github.com/casper-hansen/AutoAWQ.
 Dependencies: