mistralai/Mixtral-8x7B-Instruct-v0.1
Text Generation
•
Updated
•
480k
•
•
4.21k
Pruned MoEs (Mixtral-8x7B-Instruct-v0.1)
Pruned experts from Mixtral-8x7B-Instruct-v0.1 with respect to the paper "A Provably Effective Method for Pruning Experts in Fine-tuned Sparse MoEs"
-
-
Na0s/Mixtral-8x7B-Instruct-v0.1-LoRA-on-Gates
Text Generation • Updated • 11 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA
Text Generation • Updated • 16 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-1-experts
Text Generation • Updated • 11 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-2-experts
Text Generation • Updated • 7 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-3-experts
Text Generation • Updated • 5 -
Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-4-experts
Text Generation • Updated • 14 -
Na0s/Mixtral-8x7B-v0.1-instruct-l2-norm-post-Gates-SFT-pruned-1-experts
Text Generation • Updated • 8 -
Na0s/Mixtral-8x7B-v0.1-instruct-l2-norm-post-Gates-SFT-pruned-2-experts
Text Generation • Updated • 12 -
Na0s/Mixtral-8x7B-v0.1-instruct-l2-norm-post-Gates-SFT-pruned-3-experts
Text Generation • Updated • 11 -
Na0s/Mixtral-8x7B-v0.1-instruct-l2-norm-post-Gates-SFT-pruned-4-experts
Text Generation • Updated • 12 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-1-expert
Text Generation • Updated • 10 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-2-experts
Text Generation • Updated • 10 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-3-experts
Text Generation • Updated • 8 -
Na0s/Mixtral-8x7B-Instruct-v0.1-exhaustive-LoRA-SFT-pruned-4-experts
Text Generation • Updated • 13