Edit model card

take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch. take the mistral inst-v02 model and run dpo on it, 6000 epoch.

Downloads last month
3,101
Safetensors
Model size
7.24B params
Tensor type
FP16
·