Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO-2
/
zephyr-7b-gpo-v13-i1
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
mit
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
zephyr-7b-gpo-v13-i1
Commit History
Training in progress, step 400
18155e2
verified
lole25
commited on
May 10
Training in progress, step 300
a7a0f2a
verified
lole25
commited on
May 10
initial commit
3107dae
verified
lole25
commited on
May 10
Previous
1
2
Next