etri-xainlp/SOLAR-10.7B-merge-dpo
Model Details
Model Developers ETRI xainlp team
Input text only.
Output text only.
Model Architecture
We used MergeKit to merge Model heavytail/kullm-solar into Model upstage/SOLAR-10.7B-Instruct-v1.0 as the base.
Base Model upstage/SOLAR-10.7B-Instruct-v1.0
Merge Model heavytail/kullm-solar
Training Dataset
dpo+lora: 90k user preference set
We use A100 GPU 80GB * 1, when training.
- Downloads last month
- 1,440
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.