Edit model card

Explanation

  • With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part
  • Attached the base model and the tuned adapter together

Base Model

Used Corpus

Score

Average Ko-ARC Ko-HellaSwag Ko-MMLU Ko-TruthfulQA Ko-CommonGen V2
56.24 53.33 64.36 55.63 45.42 62.46

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • Apache 2.0
Downloads last month
1,201
Safetensors
Model size
10.8B params
Tensor type
FP16
·

Dataset used to train dddsaty/KoSOLAR-10.7B_DPO_Adapter_Attach