Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-gpo-new-v1-i0
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
55b3a63
zephyr-7b-gpo-new-v1-i0
/
adapter_config.json
Commit History
Training in progress, step 6300
55b3a63
verified
lole25
commited on
May 11
Training in progress, step 1100
b757876
verified
lole25
commited on
May 10
Training in progress, step 100
5df7d97
verified
lole25
commited on
May 10