SimPO: Simple Preference Optimization with a Reference-Free Reward
Paper • 2405.14734 • Published • 13
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
Mistral-7B-Base-SFT-RDPO - bnb 4bits
- Model creator: https://huggingface.co/princeton-nlp/
- Original model: https://huggingface.co/princeton-nlp/Mistral-7B-Base-SFT-RDPO/
Original model description: This is a model released from the preprint: SimPO: Simple Preference Optimization with a Reference-Free Reward Please refer to our repository for more details.
- Downloads last month
- 8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support