---
license: cc-by-nc-4.0
tags:
- merge
---

# etri-xainlp/SOLAR-10.7B-merge-dpo_v1

## Model Details

**Model Developers** ETRI xainlp team

**Input** text only.

**Output** text only.

**Model Architecture**  

We used MergeKit to merge Model heavytail/kullm-solar into Model etri-xainlp/SOLAR-10.7B-merge-dpo as the base.

**Base Model**  [etri-xainlp/SOLAR-10.7B-merge-dpo](https://huggingface.co/etri-xainlp/SOLAR-10.7B-merge-dpo)  

**Merge Model**  [davidkim205/komt-solar-10.7b-sft-v5](https://huggingface.co/davidkim205/komt-solar-10.7b-sft-v5)

**Training Dataset**  
  
 - dpo+lora: 100k user preference set

 - We use A100 GPU 80GB * 8, when training.