Edit model card

image/png

image/png

T3Q-ko-solar-dpo-v6.0

This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.

Model Developers Chihoon Lee(chihoonlee10), T3Q

hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.5028 ± 0.0133
macro_f1 0.3396 ± 0.0067
kobest_copa 0 acc 0.8020 ± 0.0126
macro_f1 0.8018 ± 0.0126
kobest_hellaswag 0 acc 0.5340 ± 0.0223
acc_norm 0.5720 ± 0.0221
macro_f1 0.5322 ± 0.0224
kobest_sentineg 0 acc 0.7985 ± 0.0202
macro_f1 0.7956 ± 0.0205
Downloads last month
2,138
Safetensors
Model size
10.7B params
Tensor type
FP16
·
Inference API
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.