wang7776 commited on
Commit
c847fe3
1 Parent(s): 9dda6f1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -21,6 +21,10 @@ tags:
21
  - llama-2
22
  license: other
23
  ---
 
 
 
 
24
  # **Llama 2**
25
  Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B fine-tuned model, optimized for dialogue use cases and converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom.
26
 
 
21
  - llama-2
22
  license: other
23
  ---
24
+ # Overview
25
+ This model has been pruned to 10% sparsity using the [Wanda pruning method](https://arxiv.org/abs/2306.11695). This method requires no retraining or weight updates and still achieves competitive performance. A link to the base model can be found [here](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf).
26
+
27
+
28
  # **Llama 2**
29
  Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the repository for the 7B fine-tuned model, optimized for dialogue use cases and converted for the Hugging Face Transformers format. Links to other models can be found in the index at the bottom.
30