YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

SLM (small human model)

Tiny transformer LM trained from scratch on a toy corpus in Colab.

  • params: 17.78M
  • arch: {'n_embd': 384, 'n_layer': 10, 'n_head': 8, 'block_size': 64}
  • vocab: .abcdefghijklmnopqrstuvwxyz

Usage

from model import load_model, sample
model, vocab = load_model("mohar07/PunyPunk")
print(sample(model, vocab, "the quick", new_tokens=200))
Downloads last month
20
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support