pruned-yi/pruned-yi-3b-prerelease-ckpt01
Text Generation
•
Updated
•
752
•
1
Pruned Yi
community
AI & ML interests
Creating pruned versions of 01.AI's Yi models. Not affiliated with 01.AI or Yi.
Organization Card
About org cards
Pruned Yi
Creating <6B SLM models based on 01.AI's amazing Yi models!
Not affiliated with 01.AI in any way.
What is a pruned model?
"Pruning" refers to selectively removing layers from a LLM to create a smaller LLM. Once pruned, the models must be further trained before they can generate coherent text.
Pruning is an easy way to create smaller LLMs from larger LLMs without having to re-train from scratch!
Models
Please check out the GitHub repository/homepage for a list of models.
datasets
None public yet