Transformers
Safetensors
English
charlm
tiny
tiny-lm
small-language-model
sub-1m
char-level
from-scratch
nanoGPT
TinyStories
Instructions to use Compactbot/char-gpt-1.2m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Compactbot/char-gpt-1.2m with Transformers:
# Load model directly from transformers import CharGPT model = CharGPT.from_pretrained("Compactbot/char-gpt-1.2m", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Correct held-out perplexity to full-split test 1.4369 / 4.21 (was 60-batch log numbers)
#7
by Compactbot - opened
No description provided.
Merging: corrects held-out perplexity from the 60-batch training-log numbers (val 1.9046 / test 1.9473) to the honest full-split measurement (loss 1.4369 / ppl 4.21 on 49,674 test tokens). Text-only change.
Compactbot changed pull request status to merged