Edit model card

FusionNet_34Bx2_MoE_v0.1

Fine-tuned model on English language using MoE method. The improved version from FusionNet_34Bx2_MoE.

Model description

The FusionNet_34Bx2_MoE_v0.1 is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 60.8B parameters, and this model is fine-tuned. Enjoy!

Downloads last month
1,117
Safetensors
Model size
60.8B params
Tensor type
BF16
·