amd
/

Qwen1.5-7B-Chat-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation

Model card Files Files and versions Community

uday610 commited on Dec 3, 2024

Commit

92b2094

•

1 Parent(s): 412389f

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -12,7 +12,8 @@ tags:
 # Qwen/Qwen1.5-7B-Chat
 - ## Introduction
   - Quantization Tool: Quark 0.6.0
-  - OGA Model Builder: v0.5.1
 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
   - Excluded Layers: None

 # Qwen/Qwen1.5-7B-Chat
 - ## Introduction
   - Quantization Tool: Quark 0.6.0
+  - OGA Model Builder: v0.5.1
+  - Postprocess
 - ## Quantization Strategy
   - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
   - Excluded Layers: None