Model: ControlLLM/Llama-3.1-8B-SynE-Concat16-Dlerp
Author: ControlLLM
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, text-generation, zh, dataset:survivi/Llama-3-SynE-Dataset, dataset:hfl/stem_zh_instruction, dataset:llamafactory/alpaca_zh, dataset:llamafactory/alpaca_gpt4_zh, dataset:hfl/ruozhiba_gpt4, dataset:codingsteven/Llama-3-8B-chat, arxiv:2501.10979, arxiv:2410.14745, base_model:meta-llama/Llama-3.1-8B, base_model:finetune:meta-llama/Llama-3.1-8B, license:llama3.1, model-index, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.1-8B
Card metadata: license: llama3.1
datasets: survivi/Llama-3-SynE-Dataset, hfl/stem_zh_instruction, llamafactory/alpaca_zh, llamafactory/alpaca_gpt4_zh, hfl/ruozhiba_gpt4, codingsteven/Llama-3-8B-chat
language: zh
metrics: accuracy
base_model: meta-llama/Llama-3.1-8B
pipeline_tag: text-generation
library_name: transformers
model-index: name: Control-LLM-Llama3.1-8B-SynE-Concat16-Dlerp
results: task: type: pretraining-evaluation
dataset: type: mixed
name: Pretraining Evaluation Dataset
metrics: name: exact_match,strict-match (meta_pretrain)
type: exact_match
value: 0.48514264142803215
stderr: 0.003513307445696379
verified: no, name: exact_match,strict-match (meta_bbh_3shot_cot_pretrain)
type: exact_match
value: 0.6817693134695131
stderr: 0.0057729694388110805
verified: no, name: acc,none (meta_mmlu_5shot_pretrain)
type: accuracy
value: 0.65596068936049
stderr: 0.0040090726054856874
verified: no, name: exact_match,strict-match (meta_mmlu_pro_5shot_pretrain)
type: exact_match
value: 0.3787400265957447
stderr: 0.004422383756050139
verified: no, task: type: chinese-evaluation
dataset: type: mixed
name: Chinese Evaluation Dataset
metrics: name: exact_match,strict-match (zh_pretrain_multishot)
type: exact_match
value: 0.44848391089108913
stderr: 0.004255614019851072
verified: no, name: acc,none (ceval-valid)
type: accuracy
value: 0.5698365527488856
stderr: 0.012893833892221353
verified: no, name: exact_match,strict-match (ceval-valid-pretrain-cot_zh)
type: exact_match
value: 0.4472511144130758
stderr: 0.013203606600472227
verified: no, name: acc,none (cmmlu)
type: accuracy
value: 0.5602659298912105
stderr: 0.0044928840587441605
verified: no, name: exact_match,strict-match (cmmlu_pretrain_cot_zh)
type: exact_match
value: 0.4486271801070627
stderr: 0.00449553418468653
verified: no
Likes: 0 | All-time downloads: 148
Created: 2025-01-09 09:55:18