Shamane commited on
Commit
f52be62
1 Parent(s): da98325

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -8,9 +8,11 @@ datasets:
8
  ---
9
  ## Quick Summary
10
 
11
- This model is an adaptation of the `mistralai/Mistral-7B-Instruct-v0.2`, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the `MergeKit` and `PruneMe` repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
12
 
13
- ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/654aa1d86167ff03f70e32f9/RcZ0aj8JRiom1jF5UOz85.webp)
 
 
14
 
15
  ### Model Description
16
 
 
8
  ---
9
  ## Quick Summary
10
 
11
+ This model is
12
 
13
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/654aa1d86167ff03f70e32f9/zQFDg3iLKaks-GTAfppVA.png)
14
+
15
+ an adaptation of the `mistralai/Mistral-7B-Instruct-v0.2`, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the `MergeKit` and `PruneMe` repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
16
 
17
  ### Model Description
18