Edit model card

TinyKAI 0.7B

image/png

Model Details

TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER! We acheived such a feat by essentially compressing GPT2 and squeezing it to fit into one sub-GB pytorch.bin file!

Uses

Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.

Banned Use

TinyKAI-1B is governed by the apache 2.0 liscense, and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of ANY AND ALL KAI MODELS for hate speech towards a paricular thing, person, our particular group due to legal and ethical issues.

Limitations

2K characters max output length, English only, and extremely tiny (1GB).

Recommendations

TinyKAI-0.7B is a very small model, and is good for AI research especially.

Downloads last month
5
Safetensors
Model size
137M params
Tensor type
F32
·
U8
·

Datasets used to train Keynote-Technology/TinyKAI-0.7B-v0.1

Collections including Keynote-Technology/TinyKAI-0.7B-v0.1