YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is a GPT-2 model trained in llm.c for 100K steps (of 1M batch size) on FineWeb-EDU.

A lot more detailed information is here: https://github.com/karpathy/llm.c/discussions/677 .

This model is exactly as the post above, except changing -x 100000 to run 100K steps. The model achieves HellaSwag of 57.7

Downloads last month
67
Safetensors
Model size
1.56B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for karpathy/gpt2_1558M_final3_hf

Quantizations
1 model