SimPO: Simple Preference Optimization with a Reference-Free Reward
Paper • 2405.14734 • Published • 13
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
Llama-3-Instruct-8B-RDPO - bnb 4bits
Original model description: This is a model released from the preprint: SimPO: Simple Preference Optimization with a Reference-Free Reward Please refer to our repository for more details.