Hugging Face model: nthngdy/grad_bottleneck_2B
Author: nthngdy
Created: 2026-01-19 16:38:27
Last modified: 2026-08-07 21:09:45
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, softmax-bottleneck, gradient-bottleneck, lm-head, research, controlled-pretraining, colm2026, text-generation, en, dataset:HuggingFaceFW/fineweb-edu, arxiv:2603.10145, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
language: en
library_name: transformers
pipeline_tag: text-generation
tags: softmax-bottleneck, gradient-bottleneck, lm-head, research, controlled-pretraining, colm2026
datasets: HuggingFaceFW/fineweb-edu