Model: ControlLLM/Llama-3.1-8B-SynE-FPT
Author: ControlLLM
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, text-generation, zh, dataset:survivi/Llama-3-SynE-Dataset, dataset:hfl/stem_zh_instruction, dataset:llamafactory/alpaca_zh, dataset:llamafactory/alpaca_gpt4_zh, dataset:hfl/ruozhiba_gpt4, dataset:codingsteven/Llama-3-8B-chat, arxiv:2501.10979, base_model:meta-llama/Llama-3.1-8B, base_model:finetune:meta-llama/Llama-3.1-8B, license:llama3.1, model-index, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.1-8B
Card metadata: license: llama3.1
datasets: survivi/Llama-3-SynE-Dataset, hfl/stem_zh_instruction, llamafactory/alpaca_zh, llamafactory/alpaca_gpt4_zh, hfl/ruozhiba_gpt4, codingsteven/Llama-3-8B-chat
language: zh
metrics: accuracy
base_model: meta-llama/Llama-3.1-8B
model-index: name: Control-LLM-Llama3.1-8B-SynE-Full-Parameter-Tuning
results: task: type: pretraining-evaluation
dataset: type: mixed
name: Pretraining Evaluation Dataset
metrics: name: exact_match,strict-match (meta_pretrain)
type: exact_match
value: 0.45445720757159036
stderr: 0.0035036029889520047
verified: no, name: exact_match,strict-match (meta_bbh_3shot_cot_pretrain)
type: exact_match
value: 0.6482875134387959
stderr: 0.005918167158231359
verified: no, name: acc,none (meta_mmlu_5shot_pretrain)
type: accuracy
value: 0.649480131035465
stderr: 0.004026616190778244
verified: no, name: exact_match,strict-match (meta_mmlu_pro_5shot_pretrain)
type: exact_match
value: 0.34956781914893614
stderr: 0.004347262544061378
verified: no, task: type: chinese-evaluation
dataset: type: mixed
name: Chinese Evaluation Dataset
metrics: name: acc,none (ceval-valid)
type: accuracy
value: 0.5898959881129272
stderr: 0.012699457390113113
verified: no, name: exact_match,strict-match (ceval-valid-pretrain-cot_zh)
type: exact_match
value: 0.40193164933135217
stderr: 0.01265090064840271
verified: no, name: acc,none (cmmlu)
type: accuracy
value: 0.6018822310481782
stderr: 0.004420298073040671
verified: no, name: exact_match,strict-match (cmmlu_pretrain_cot_zh)
type: exact_match
value: 0.4425833189431877
stderr: 0.004506238417180843
verified: no
pipeline_tag: text-generation
library_name: transformers
Likes: 0 | All-time downloads: 211
Created: 2025-01-09 09:43:47