Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
DUAL-GPO
/
zephyr-7b-gpo-v3-i3
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Use this model
main
zephyr-7b-gpo-v3-i3
/
adapter_model.safetensors
Commit History
Model save
8dcf96c
verified
lole25
commited on
May 14
Training in progress, step 2600
4a83e81
verified
lole25
commited on
May 14
Training in progress, step 2500
f077a04
verified
lole25
commited on
May 14
Training in progress, step 2400
36569f8
verified
lole25
commited on
May 14
Training in progress, step 2200
b2b6740
verified
lole25
commited on
May 14
Training in progress, step 2100
586af82
verified
lole25
commited on
May 14
Training in progress, step 2000
3d38c52
verified
lole25
commited on
May 14
Training in progress, step 1700
253e0bf
verified
lole25
commited on
May 14
Training in progress, step 1600
4038e57
verified
lole25
commited on
May 14
Training in progress, step 1400
c0d7b25
verified
lole25
commited on
May 14
Training in progress, step 1200
786a046
verified
lole25
commited on
May 14
Training in progress, step 1100
ce3b100
verified
lole25
commited on
May 14
Training in progress, step 1000
f823d1c
verified
lole25
commited on
May 14
Training in progress, step 900
0680e91
verified
lole25
commited on
May 14
Training in progress, step 500
ace6fac
verified
lole25
commited on
May 14
Training in progress, step 400
452ba92
verified
lole25
commited on
May 14
Training in progress, step 200
e246cf3
verified
lole25
commited on
May 13
Training in progress, step 100
59e0aa8
verified
lole25
commited on
May 13