Char-level GPT (Bible text)

Custom-architecture GPT trained from scratch on a character-level tokenizer.

  • Training step: 4000
  • Best val loss: 1.1844894886016846
  • Block size at save: 256

This is not a transformers-compatible model. To load it, download gpt_best.pt and use the same GPT class definition from the training notebook:

ckpt = torch.load("gpt_best.pt", map_location="cpu", weights_only=False)
model = GPT(ckpt["config"])
model.load_state_dict(ckpt["model_state_dict"])
stoi, itos = ckpt["stoi"], ckpt["itos"]
Downloads last month
17
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support