Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
EllieS
/
zephyr-7b-dpo-lora-pubmedqa-ultrafeedback
like
0
PEFT
TensorBoard
Safetensors
HuggingFaceH4/ultrafeedback_binarized
mistral
alignment-handbook
Generated from Trainer
trl
dpo
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
1
Train
Use this model
main
zephyr-7b-dpo-lora-pubmedqa-ultrafeedback
/
adapter_model.safetensors
Commit History
Model save
9428d29
verified
EllieS
commited on
Jan 18
Training in progress, step 7000
e7d2302
verified
EllieS
commited on
Jan 17
Training in progress, step 5000
69322f6
verified
EllieS
commited on
Jan 17
Training in progress, step 1000
fd7773a
verified
EllieS
commited on
Jan 17