Edit model card

Model Card for Model ID

This is a GPT-2 model trained in llm.c, for 32K steps (of 1M batch size) on FineWeb-EDU.

A lot more detailed information is here: https://github.com/karpathy/llm.c/discussions/677

Bias, Risks, and Limitations

Eagerly generates disinformation about English-speaking unicorns in the Andes mountains.

Downloads last month
350
Safetensors
Model size
1.56B params
Tensor type
BF16
·
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Space using karpathy/gpt2_1558M_final2_hf 1