CodeTriad/mistral_base_15000_dpo_again_first

Uploaded model

• Developed by: CodeTriad
• License: apache-2.0
• Finetuned from model : unsloth/mistral-7b-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.