Cortex-4-Beta-story

A small GPT model for story generation, trained completely from scratch (custom PyTorch architecture, no transformers library involved).

• Parameters: 104.6M
• Weights format: fp16
• Architecture: Decoder-only Transformer (custom implementation)
• Training: from scratch, no pretrained weights used

How to run

2. Install dependencies:

pip install -r requirements.txt

3. Run:

python chat.py

Example

You: Once upon a time Cortex_2: Once upon a time there was a little girl who wanted to explore the world...

Limitations

This is a small model, so it may lose coherence, mix up facts, or cut off mid-thought — expected behavior for this parameter count.