yunconglong
/

Mixtral_7Bx2_MoE_13B_DPO

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral_7Bx2_MoE_13B_DPO / README.md

yunconglong's picture

Create README.md

8863572 verified 6 months ago

|

No virus

420 Bytes

metadata

license: cc-by-nc-4.0
tags:
  - moe

Mixtral MOE 2x7B

MOE the following models by mergekit and then fine tuned by DPO.