README.md

---
license: apache-2.0
---


![image/png](https://cdn-uploads.huggingface.co/production/uploads/6699b80354725cd6e0ae8e19/hjsTgTggQdexMlvCYyqfK.png)

Llama3.1 70B instruct를 unsloth로 dpo 파인튜닝했습니다.

데이터셋 : https://github.com/DopeorNope-Lee/Ko-Fine-tuning_DataGen/tree/main

Contact : cgh@tnap.co.kr