wang7776 commited on
Commit
f1f91e2
1 Parent(s): 9f83457

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -6,6 +6,10 @@ tags:
6
  inference: false
7
  ---
8
 
 
 
 
 
9
  # Model Card for Mistral-7B-Instruct-v0.2
10
 
11
  The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an improved instruct fine-tuned version of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1).
 
6
  inference: false
7
  ---
8
 
9
+ # Overview
10
+ This model has been pruned to 10% sparsity using the [Wanda pruning method](https://arxiv.org/abs/2306.11695). This method requires no retraining or weight updates and still achieves competitive performance. A link to the base model can be found [here](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2).
11
+
12
+
13
  # Model Card for Mistral-7B-Instruct-v0.2
14
 
15
  The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an improved instruct fine-tuned version of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1).