amd
/

Mistral-7B-Instruct-v0.3-awq-g128-int4-asym-fp16-onnx-hybrid

Model card Files Files and versions Community

uday610 commited on 16 days ago

Commit

1dacc89

•

1 Parent(s): e1aa29b

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -8,7 +8,8 @@ base_model:
 # mistralai/Mistral-7B-Instruct-v0.3
 - ## Introduction
   - Quantization Tool: Quark 0.6.0
-  - OGA Model Builder: v0.5.1
 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
   - Excluded Layers: None

 # mistralai/Mistral-7B-Instruct-v0.3
 - ## Introduction
   - Quantization Tool: Quark 0.6.0
+  - OGA Model Builder: v0.5.1
+  - PostProcess
 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
   - Excluded Layers: None