Model Card for Model ID

Model Details

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]

Uses

Evaluation

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM2-sft1.0-dpo1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.9274 ± 0.0069
macro_f1 0.9272 ± 0.0069
kobest_copa 0 acc 0.7690 ± 0.0133
macro_f1 0.7684 ± 0.0134
kobest_hellaswag 0 acc 0.5280 ± 0.0223
acc_norm 0.5600 ± 0.0222
macro_f1 0.5263 ± 0.0222
kobest_sentineg 0 acc 0.6474 ± 0.0240
macro_f1 0.6072 ± 0.0254
Downloads last month
70
Safetensors
Model size
10.7B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for T3Q-LLM/T3Q-LLM2-sft1.0-dpo1.0

Quantizations
1 model

Spaces using T3Q-LLM/T3Q-LLM2-sft1.0-dpo1.0 6