File size: 385 Bytes
45f1ea0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: mit
datasets:
- HuggingFaceFW/fineweb
language:
- en
---
# llm.c checkpoint: GPT-2 774M
This is a HF/safetensors conversion of the llm.c checkpoint of a 774M parameter run on 150B tokens from FineWeb.
Training was conducted on a single 8xA100 80GB SXM node for ~6 days.
See [discussion on GitHub](https://github.com/karpathy/llm.c/discussions/580) for more information. |