File size: 450 Bytes
b7eb2d1 644451f b7eb2d1 644451f |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: mit
language:
- en
pipeline_tag: text-generation
tags:
- moe
---
# FusionNet_7Bx2_MoE_v0.1
Fine-tuned model on English language using MoE method. The improved version from FusionNet_7Bx2_MoE_14B.
## Model description
The FusionNet_7Bx2_MoE_v0.1 is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy! |