munish0838 commited on
Commit
8e50a10
1 Parent(s): 529cfdc

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ base_model: princeton-nlp/Mistral-7B-Instruct-DPO
5
+ ---
6
+
7
+ # QuantFactory/Mistral-7B-Instruct-DPO-GGUF
8
+ This is quantized version of [princeton-nlp/Mistral-7B-Instruct-DPO](https://huggingface.co/princeton-nlp/Mistral-7B-Instruct-DPO) created using llama.cpp
9
+
10
+ # Model Description
11
+ This is a model released from the preprint: *[SimPO: Simple Preference Optimization with a Reference-Free Reward](https://arxiv.org/abs/2405.14734)* Please refer to our [repository](https://github.com/princeton-nlp/SimPO) for more details.