Model: ControlLLM/Llama-3.1-8B-SynE-Hybrid16
Author: ControlLLM
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, text-generation, zh, dataset:survivi/Llama-3-SynE-Dataset, dataset:hfl/stem_zh_instruction, dataset:llamafactory/alpaca_zh, dataset:llamafactory/alpaca_gpt4_zh, dataset:hfl/ruozhiba_gpt4, dataset:codingsteven/Llama-3-8B-chat, arxiv:2501.10979, base_model:meta-llama/Llama-3.1-8B, base_model:finetune:meta-llama/Llama-3.1-8B, license:llama3.1, model-index, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.1-8B
Card metadata: license: llama3.1
datasets: survivi/Llama-3-SynE-Dataset, hfl/stem_zh_instruction, llamafactory/alpaca_zh, llamafactory/alpaca_gpt4_zh, hfl/ruozhiba_gpt4, codingsteven/Llama-3-8B-chat
language: zh
metrics: accuracy
base_model: meta-llama/Llama-3.1-8B
model-index: name: Control-LLM-Llama3.1-8B-SynE-Hybrid
results: task: type: pretraining-evaluation
dataset: type: mixed
name: Pretraining Evaluation Dataset
metrics: name: exact_match,strict-match (meta_pretrain)
type: exact_match
value: 0.4677775980154236
stderr: 0.0035271375539740195
verified: no, name: exact_match,strict-match (meta_bbh_3shot_cot_pretrain)
type: exact_match
value: 0.6516664106896022
stderr: 0.005904999312183116
verified: no, name: acc,none (meta_mmlu_5shot_pretrain)
type: accuracy
value: 0.6574562028201111
stderr: 0.004004907112115045
verified: no, name: exact_match,strict-match (meta_mmlu_pro_5shot_pretrain)
type: exact_match
value: 0.36826795212765956
stderr: 0.004397416024070344
verified: no, task: type: chinese-evaluation
dataset: type: mixed
name: Chinese Evaluation Dataset
metrics: name: exact_match,strict-match (zh_pretrain_multishot)
type: exact_match
value: 0.4448483910891089
stderr: 0.004279257037413458
verified: no, name: acc,none (ceval-valid)
type: accuracy
value: 0.5891530460624071
stderr: 0.012995719777231915
verified: no, name: exact_match,strict-match (ceval-valid-pretrain-cot_zh)
type: exact_match
value: 0.44650817236255574
stderr: 0.013132438471522461
verified: no, name: acc,none (cmmlu)
type: accuracy
value: 0.578742876877914
stderr: 0.004459355253649275
verified: no, name: exact_match,strict-match (cmmlu_pretrain_cot_zh)
type: exact_match
value: 0.4446554999136591
stderr: 0.004526020080338497
verified: no
pipeline_tag: text-generation
library_name: transformers
Likes: 0 | All-time downloads: 143
Created: 2025-01-09 09:46:23