arcee-ai
/

Mistral-7B-Instruct-v0.2-sliced-24-layer

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Shamane commited on Apr 11

Commit

5266d90

•

1 Parent(s): 1c7ced6

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ datasets:
 This model is an adaptation of the `mistralai/Mistral-7B-Instruct-v0.2`, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the `MergeKit` and `PruneMe` repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
-<img src="https://cdn-uploads.huggingface.co/production/uploads/654aa1d86167ff03f70e32f9/zQFDg3iLKaks-GTAfppVA.png" width="500" height="auto">
 ### Model Description

 This model is an adaptation of the `mistralai/Mistral-7B-Instruct-v0.2`, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the `MergeKit` and `PruneMe` repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
+<img src="https://cdn-uploads.huggingface.co/production/uploads/654aa1d86167ff03f70e32f9/CwiPyc9GIft4Iy_Howe9h.webp" width="300" height="auto">
 ### Model Description