Merge pull request #1 from huggingface/generate-dpo-dataset
6d59547
unverified
burtenshaw
commited on
Commit History
Update data/generate_dpo.py
873f98c
respond to feedback on prompts
01ba912
burtenshaw
commited on
Update data/generate_dpo.py
3fbe04f
unverified
add example data and download
fe1770b
burtenshaw
commited on
add dependencies
3a1bb5f
burtenshaw
commited on
implement generate from ratings for dpo
dc616b0
burtenshaw
commited on
add trl script
aac30ac
burtenshaw
commited on
first refactored commit
9cc6120
burtenshaw
commited on
migrate all ml files into subdir
e9484c6
burtenshaw
commited on
Update README.md
c41b5cd
jenbenarye
commited on
updated to only load preference data
239efc0
Jen Ben Arye
commited on
updated kto pipeline to work with general dataset
71053f2
Jen Ben Arye
commited on
script to load datasets in kto schema
c8a2d4e
Jen Ben Arye
commited on
updated kto pipeline to work with general dataset
0e83f57
Jen Ben Arye
commited on
kto
6498d39
Jen Ben Arye
commited on
Update README.md
7ee0f15
jenbenarye
commited on
added kro dataset schema to README.md
2bad840
jenbenarye
commited on
Delete index.html
4e67485
jenbenarye
commited on
Update README.md
b3aaee8
jenbenarye
commited on
Update README.md
dd2b90d
jenbenarye
commited on
Add files via upload
261522b
Riddhi Bhagwat
commited on
script to generate responses and save then as json
04f923c
Jen Ben Arye
commited on
converted kto_eval to py file
4eefaf3
Jen Ben Arye
commited on
trained model using kto - sanity check
6f11489
Jen Ben Arye
commited on
cleaned training pipleine and added evaluation pipeline
669afda
Jen Ben Arye
commited on
Update README.md
4125eca
jenbenarye
commited on
Add files via upload
fd59c75
Riddhi Bhagwat
commited on
Add workflow badges to README
3f8b25a
Riddhi Bhagwat
commited on
Initial commit
ceefc61
Riddhi Bhagwat
commited on
Initial commit
01997f5
unverified
burtenshaw
commited on