T3Q-ko-solar-dpo-v6.0
This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
Model Developers Chihoon Lee(chihoonlee10), T3Q
hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5028 | ± | 0.0133 |
| macro_f1 | 0.3396 | ± | 0.0067 | ||
| kobest_copa | 0 | acc | 0.8020 | ± | 0.0126 |
| macro_f1 | 0.8018 | ± | 0.0126 | ||
| kobest_hellaswag | 0 | acc | 0.5340 | ± | 0.0223 |
| acc_norm | 0.5720 | ± | 0.0221 | ||
| macro_f1 | 0.5322 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.7985 | ± | 0.0202 |
| macro_f1 | 0.7956 | ± | 0.0205 |
- Downloads last month
- 2,061
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.