Hugging Face model: tjingrant/sparsellm-1b-40p-small-dense
Author: tjingrant
Created: 2025-04-15 17:49:01
Last modified: 2025-04-15 18:07:01
Likes: 0 | Downloads: 7
Tags: safetensors, llama, sparse, llm, sparse-pretraining, en, dataset:fineweb-edu, arxiv:2501.12486, license:mit, region:us
Card metadata:
language: en
license: mit
datasets: fineweb-edu
tags: llama, sparse, llm, sparse-pretraining
metrics: perplexity
arxiv: 2501.12486