File size: 663 Bytes
5329090 4d75b9d 5329090 4d75b9d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
license: cc-by-nc-4.0
tags:
- merge
---
# etri-xainlp/SOLAR-10.7B-merge-dpo_v1
## Model Details
**Model Developers** ETRI xainlp team
**Input** text only.
**Output** text only.
**Model Architecture**
We used MergeKit to merge Model heavytail/kullm-solar into Model etri-xainlp/SOLAR-10.7B-merge-dpo as the base.
**Base Model** [etri-xainlp/SOLAR-10.7B-merge-dpo](https://huggingface.co/etri-xainlp/SOLAR-10.7B-merge-dpo)
**Merge Model** [davidkim205/komt-solar-10.7b-sft-v5](https://huggingface.co/davidkim205/komt-solar-10.7b-sft-v5)
**Training Dataset**
- dpo+lora: 100k user preference set
- We use A100 GPU 80GB * 8, when training. |