Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
Paper • 2402.05406 • Published
Bonsai Reasoning
Working on improving reasoning of Bonsai Paper.
-
luciodery/Bonsai-PrunedPhi-1.8B
2B • Updated • 72 • 1Note Original Model with 10 iterations to get 50% sparsity
vashistht/bonsai-reasoning-adapter_prune_c4_ft_wiki
Updated • 4Note Finetuned Bonsai (pruned on C4) on Wikitext