Model and data collection for our work "Understanding Reference Policies in Direct Preference Optimization" (https://arxiv.org/abs/2407.13709)
![Yale NLP Lab's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
Yale NLP Lab
university
AI & ML interests
Natural Language Processing at Yale
Collections
1
spaces
1
models
38
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/tulu2-7b-dpo-mistralv2-7b-beta-0.005
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/tulu2-7b-dpo-beta-0.01
Text Generation
•
Updated
•
7
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/tulu2-7b-dpo-beta-0.05
Text Generation
•
Updated
•
9
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-likelihood
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-probability
Text Generation
•
Updated
•
9
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/tulu2-7b-dpo-beta-0.1
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-7b-dpo-mistralv2-7b-beta-0.005
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-7b-dpo-mistralv2-7b-beta-0.01
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-7b-dpo-mistralv2-7b-beta-0.1
Text Generation
•
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65204db5b0e0d57453cb1809/9OAeiZ-BrN2g1h1yd6-1W.png)
yale-nlp/mistral-7b-dpo-mistralv2-7b-beta-1.0
Text Generation
•
Updated
•
8