Slayer 11B pilot weights

Private backup of an experimental approximately 11.18B-parameter model trained from scratch on a subset of SlayerLab/slayer-pl-8x3b. This is an early pilot, not a finished or evaluated model.

weights-only.pt is a PyTorch dictionary containing model, config, and step. It preserves the original weight precision, but does not contain the optimizer state and cannot resume the original training state exactly. This uses the custom train_gpt.py architecture, not Transformers format; the reference tokenizer is SlayerLab/Slayer1B-1.00. Load PyTorch files only from trusted sources. The file appears after export and upload finish.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support