File size: 631 Bytes
f397f9d 9da4c7a 0543c21 f397f9d c0027e7 0e87f8e c0027e7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
license: cc-by-nc-4.0
tags:
- merge
---
# etri-xainlp/SOLAR-10.7B-merge-dpo
## Model Details
**Model Developers** ETRI xainlp team
**Input** text only.
**Output** text only.
**Model Architecture**
We used MergeKit to merge Model heavytail/kullm-solar into Model upstage/SOLAR-10.7B-Instruct-v1.0 as the base.
**Base Model** [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)
**Merge Model** [heavytail/kullm-solar](https://huggingface.co/heavytail/kullm-solar)
**Training Dataset**
- dpo+lora: 90k user preference set
- We use A100 GPU 80GB * 1, when training. |