---
license: mit
language:
- en
pipeline_tag: text-generation
tags:
- moe
---
# FusionNet_7Bx2_MoE_v0.1
Fine-tuned model on English language using MoE method. The improved version from FusionNet_7Bx2_MoE_14B.
## Model description
The FusionNet_7Bx2_MoE_v0.1 is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!