Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
chchen
/
Mistral-7B-Instruct-v0.2-ORPO
like
0
PEFT
Safetensors
llama-factory
lora
trl
dpo
Generated from Trainer
License:
apache-2.0
Model card
Files
Files and versions
Community
Use this model
16e1e32
Mistral-7B-Instruct-v0.2-ORPO
/
.ipynb_checkpoints
1 contributor
History:
2 commits
chchen
Training in progress, step 500
a144b89
verified
5 months ago
lora_orpo-checkpoint.yaml
Safe
832 Bytes
Training in progress, step 500
5 months ago
tokenizer_config-checkpoint.json
Safe
1.41 kB
Training in progress, step 500
5 months ago
training_loss-checkpoint.png
Safe
45.1 kB
Training in progress, step 500
5 months ago
training_rewards_accuracies-checkpoint.png
Safe
54.9 kB
Training in progress, step 500
5 months ago
training_sft_loss-checkpoint.png
Safe
45.6 kB
Training in progress, step 500
5 months ago