tait-test-demo
A small MiniGPT model trained with TAIT, a NumPy-only toolkit for training AI on phones and resource-constrained devices.
Model details
- Format: TAIT
.npz(NumPy weights + BPE tokenizer, readable by the KAIT runner) - File:
tait-test-model.npz(105454 bytes, sha2562d31921c7c48f2ec...) - Vocab size: 403
- d_model: 16 | d_ff: 32 | block_size: 23
- TAIT version: 2.3.0
- Training data: demo.jsonl
- Training examples: 8
- Epochs: 2
- Final training loss: 6.3599
- Validation loss: 6.3232
How to use it
pip install "tait[publish]" # publish support; training itself needs only NumPy
# Download the model, then chat with it locally:
tait chat --model tait-test-model.npz
You can also load the same .npz file in KAIT, the Android
runner for TAIT models, by pasting this repository link there.
Limitations
This is a tiny model trained from scratch on a small dataset. It may hallucinate, repeat itself, or answer off-topic. Treat its output as an experiment, not as a factual source.
Source
Trained with TAIT: https://github.com/muzammilsoft/tait