Hugging Face's logo

PJMixers-Archive
/
LLaMa-3-Instruct-Catboros-3.2-ORPO-8B

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Model card Files Community
LLaMa-3-Instruct-Catboros-3.2-ORPO-8B
File size: 693 Bytes 
54ca25e
 
 
 
 
cc36928
54ca25e
cc36928
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
 
---
datasets:
- PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT
- antiven0m/catboros-3.2-dpo
---
Trained on [antiven0m/catboros-3.2-dpo](https://huggingface.co/datasets/antiven0m/catboros-3.2-dpo).

![train/rewards](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/images/rewards.png)
![train/logits](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/images/logits.png)
![train/logps](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/images/logps.png)
![train](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/images/train.png)