Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
•
1
Pere Martra
oopere
AI & ML interests
Author of the Book 'Large Language Models Projects: Apply and Implement Strategies for Large Language Models' published by Apress.
Recent Activity
upvoted
an
article
2 days ago
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
updated
a model
14 days ago
oopere/pruned40-llama-1b
updated
a model
14 days ago
oopere/pruned20-llama-1b
Articles
Organizations
Collections
2
models
6
oopere/pruned40-llama-1b
Text Generation
•
Updated
•
56
oopere/pruned20-llama-1b
Text Generation
•
Updated
•
52
oopere/pruned40-gemma-2-2b
Text Generation
•
Updated
•
33
oopere/pruned60-llama-1b
Text Generation
•
Updated
•
39
oopere/martra-open-gemma-2b-it-dpo
Text Generation
•
Updated
•
12
•
1
oopere/martra-phi-3-mini-dpo
Text Generation
•
Updated
•
6
•
1