Hugging Face model: openbmb/DensingLaw-ScalingModels
Author: openbmb
Created: 2025-07-24 06:27:39
Last modified: 2025-08-04 04:12:30
Pipeline: text-generation
Library: transformers
Likes: 4 | Downloads: 0
Tags: transformers, text-generation, scaling-laws, densing-law, reference-models, en, zh, dataset:mmlu, dataset:big-bench-hard, dataset:math, dataset:mbpp, dataset:human-eval, arxiv:2412.04315, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
language: en, zh
library_name: transformers
tags: text-generation, scaling-laws, densing-law, reference-models
datasets: mmlu, big-bench-hard, math, mbpp, human-eval
metrics: loss, accuracy
pipeline_tag: text-generation
citation: @misc{xiao2024densinglawllms,
      title={Densing Law of LLMs}, 
      author={Chaojun Xiao and Jie Cai and Weilin Zhao and Guoyang Zeng and Biyuan Lin and Jie Zhou and Zhi Zheng and Xu Han and Zhiyuan Liu and Maosong Sun},
      year={2024},
      eprint={2412.04315},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2412.04315}, 
}