yunconglong
/

Mixtral_7Bx2_MoE_13B_DPO

Text Generation

Mixture of Experts

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

Mixtral MOE 2x7B

MOE the following models by mergekit and then fine tuned by DPO.

Downloads last month: 2,657

Safetensors

Model size

12.9B params

Tensor type

BF16

·