LLaDA 8B Instruct pruned models
Collection
SparseGPT, sink-aware, and SliceGPT at 20%, 30%, and 40%. • 9 items • Updated
llada-8b-instruct-sparsegpt-20
Source: GSAI-ML/LLaDA-8B-Instruct at 08b83a6feb34df1a6011b80c3c00c7563e963b07. Structured pruning target: 20%; pattern: 2:10. Measured values are in pruning_statistics.json. The weights and tokenizer were saved and verified by a forward pass after reload. Benchmark evaluation has not been run.
Load with transformers.AutoModel.from_pretrained(repo_id, trust_remote_code=True).
Pruned checkpoint evaluation
Full completed benchmarks only. Original weight revisions are pinned below; updating this model card does not change evaluated weights. Settings: BF16, seed 42, MC=128, batch size 32. LLaDA generation uses 256 steps and 1024 output tokens; GSM8K uses its built-in 5-shot setting, other tasks are zero-shot.
| Benchmark | Metric | Value | Weights | Raw JSON |
|---|---|---|---|---|
| task:arc_challenge | acc,none | 0.525597 | f56c3dc9ba0e | JSON |
| task:arc_challenge | acc_norm,none | 0.550341 | f56c3dc9ba0e | JSON |
| task:arc_easy | acc,none | 0.793350 | f56c3dc9ba0e | JSON |
| task:arc_easy | acc_norm,none | 0.770623 | f56c3dc9ba0e | JSON |
| task:winogrande | acc,none | 0.677979 | f56c3dc9ba0e | JSON |
An absent benchmark is pending, not a zero score. Individual raw files record the complete evaluation configuration and checkpoint provenance.
- Downloads last month
- 73
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for vanshnawander/LLaDA-8B-Instruct-SparseGPT-20
Base model
GSAI-ML/LLaDA-8B-Instruct