mgoin commited on
Commit
2ca503f
1 Parent(s): 2631819

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -2,9 +2,10 @@
2
  license: apache-2.0
3
  base_model: mistralai/Mistral-7B-Instruct-v0.3
4
  ---
5
- # [Mistral-7B-Instruct-v0.3](mistralai/Mistral-7B-Instruct-v0.3) quantized to 4bits
6
 
7
- - weight-only quantization via GPTQ to 4bits with group_size=128
 
 
8
  - GPTQ optimized for 99.75% accuracy recovery relative to the unquantized model
9
 
10
  # Open LLM Leaderboard evaluation scores
 
2
  license: apache-2.0
3
  base_model: mistralai/Mistral-7B-Instruct-v0.3
4
  ---
 
5
 
6
+ # Model Card for Mistral-7B-Instruct-v0.3 quantized to 4bit weights
7
+
8
+ - Weight-only quantization of [Mistral-7B-Instruct-v0.3](mistralai/Mistral-7B-Instruct-v0.3) via GPTQ to 4bits with group_size=128
9
  - GPTQ optimized for 99.75% accuracy recovery relative to the unquantized model
10
 
11
  # Open LLM Leaderboard evaluation scores