Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-gpo-v5-i1
like
0
Follow
DUAL Group
2
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
mit
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
40b4f06
zephyr-7b-gpo-v5-i1
/
README.md
Commit History
Update README.md
40b4f06
verified
lole25
commited on
May 7, 2024
End of training
60fcc69
verified
lole25
commited on
May 7, 2024
Model save
301e147
verified
lole25
commited on
May 7, 2024