Edit model card

FusionNet_7Bx2_MoE_v0.1

Fine-tuned model on English language using MoE method. The improved version from FusionNet_7Bx2_MoE_14B.

Model description

The FusionNet_7Bx2_MoE_v0.1 is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!

Downloads last month
1,231
Safetensors
Model size
12.9B params
Tensor type
BF16
·