PJMixers-Archive
/

LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA

Model card Files Files and versions

LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA / README.md

xzuyn's picture

Create README.md

c5cf468 verified 10 months ago

|

history blame contribute delete

548 Bytes

	---
	datasets:
	- PJMixers/SmallPrefMix-PreferenceShareGPT
	---
	![train/rewards](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/rewards.png)
	![train/logits](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/logits.png)
	![train/logps](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/logps.png)
	![train](https://huggingface.co/PJMixers/LLaMa-3-Instruct-SmallPrefMix-ORPO-8B-QDoRA/resolve/main/images/train.png)