Model: ControlLLM/Llama-3.1-8B-SynE-Concat16-Lerp
Author: ControlLLM
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, text-generation, zh, dataset:survivi/Llama-3-SynE-Dataset, dataset:hfl/stem_zh_instruction, dataset:llamafactory/alpaca_zh, dataset:llamafactory/alpaca_gpt4_zh, dataset:hfl/ruozhiba_gpt4, dataset:codingsteven/Llama-3-8B-chat, arxiv:2501.10979, base_model:meta-llama/Llama-3.1-8B, base_model:finetune:meta-llama/Llama-3.1-8B, license:llama3.1, model-index, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.1-8B
Card metadata: license: llama3.1
datasets: survivi/Llama-3-SynE-Dataset, hfl/stem_zh_instruction, llamafactory/alpaca_zh, llamafactory/alpaca_gpt4_zh, hfl/ruozhiba_gpt4, codingsteven/Llama-3-8B-chat
language: zh
metrics: accuracy
base_model: meta-llama/Llama-3.1-8B
model-index: name: Control-LLM-Llama3.1-8B-SynE-Concat16-Lerp
results: task: type: pretraining-evaluation
dataset: type: mixed
name: Pretraining Evaluation Dataset
metrics: name: exact_match,strict-match (meta_pretrain)
type: exact_match
value: 0.458555789246616
stderr: 0.003519105746208811
verified: no, name: exact_match,strict-match (meta_bbh_3shot_cot_pretrain)
type: exact_match
value: 0.6442942712332975
stderr: 0.005933310420690264
verified: no, name: acc,none (meta_mmlu_5shot_pretrain)
type: accuracy
value: 0.6464178891895741
stderr: 0.004034621567546711
verified: no, name: exact_match,strict-match (meta_mmlu_pro_5shot_pretrain)
type: exact_match
value: 0.35804521276595747
stderr: 0.004370894189453768
verified: no, task: type: chinese-evaluation
dataset: type: mixed
name: Chinese Evaluation Dataset
metrics: name: exact_match,strict-match (zh_pretrain_multishot)
type: exact_match
value: 0.37105507425742573
stderr: 0.004143191283994466
verified: no, name: acc,none (ceval-valid)
type: accuracy
value: 0.5713224368499257
stderr: 0.01292052444857274
verified: no, name: exact_match,strict-match (ceval-valid-pretrain-cot_zh)
type: exact_match
value: 0.34843982169390786
stderr: 0.01265919137729175
verified: no, name: acc,none (cmmlu)
type: accuracy
value: 0.5689000172681747
stderr: 0.004489346390434928
verified: no, name: exact_match,strict-match (cmmlu_pretrain_cot_zh)
type: exact_match
value: 0.37368330167501296
stderr: 0.00438421288652232
verified: no
pipeline_tag: text-generation
library_name: transformers
Likes: 0 | All-time downloads: 122
Created: 2025-01-09 09:54:55