Edit model card

FusionNet

Fine-tuned model on English language using MoE method.

Model description

The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!

Downloads last month
4,823
Safetensors
Model size
12.9B params
Tensor type
BF16
ยท

Space using TomGrc/FusionNet_7Bx2_MoE_14B 1