bartowski's picture
Quant for 3.5
38463e8 verified
|
raw
history blame
330 Bytes
metadata
license: mit
language:
  - en

FusionNet

Fine-tuned model on English language using MoE method.

Model description

The FusionNet is a model to experiment with the MoE method, which could significantly increase the performance of the original model. The FusionNet has 12.9B parameters, and this model is fine-tuned. Enjoy!