Hugging Face's logo

PJMixers-Archive
/
LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA

Safetensors
Model card Files Community
LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA
File size: 548 Bytes 
c5cf468
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
 
---
datasets:
- PJMixers/SmallPrefMix-PreferenceShareGPT
---
![train/rewards](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/rewards.png)
![train/logits](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/logits.png)
![train/logps](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/logps.png)
![train](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/train.png)