---
license: cc-by-nc-4.0
tags:
- merge
---

# etri-xainlp/SOLAR-10.7B-merge-dpo

## Model Details

**Model Developers** ETRI xainlp team

**Input** text only.

**Output** text only.

**Model Architecture**  

We used MergeKit to merge Model heavytail/kullm-solar into Model upstage/SOLAR-10.7B-Instruct-v1.0 as the base.

**Base Model**  [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)  

**Merge Model**  [heavytail/kullm-solar](https://huggingface.co/heavytail/kullm-solar)

**Training Dataset**  
  
 - dpo+lora: 90k user preference set

 - We use A100 GPU 80GB * 1, when training.