Running
on
CPU Upgrade
46
📚
Sparse Finetuning MPT
Explore our breakthrough in sparse fine-tuning LLMs! Our novel method maintains downstream accuracy even with >70% sparsity.
-
-
Sparse Finetuning for Inference Acceleration of Large Language Models
Paper • 2310.06927 • Published • 14 -
Running on CPU Upgrade15📚
Sparse Llama Gsm8k
-
neuralmagic/mpt-7b-gsm8k-pruned40-quant-ds
Text Generation • Updated • 1 -
neuralmagic/mpt-7b-gsm8k-pruned50-quant-ds
Text Generation • Updated -
neuralmagic/mpt-7b-gsm8k-pruned60-quant-ds
Text Generation • Updated • 2 -
neuralmagic/mpt-7b-gsm8k-pruned70-quant-ds
Text Generation • Updated • 1 • 1 -
neuralmagic/mpt-7b-gsm8k-pruned75-quant-ds
Text Generation • Updated • 1 -
neuralmagic/mpt-7b-gsm8k-pruned80-quant-ds
Text Generation • Updated • 3 • 2 -
neuralmagic/mpt-7b-gsm8k-quant-ds
Text Generation • Updated • 2 • 1 -
neuralmagic/mpt-7b-gsm8k-pruned60-pt
Text Generation • Updated • 1 -
neuralmagic/mpt-7b-gsm8k-pt
Text Generation • Updated • 2 • 1