This model is trained off of Josephgflowers/TinyLlama-v1.1-Agent-Rag-Nerd-v1 which is trained off of the tinyllama v1.1. This model was trained using the tinyllama chat format, zephyr. I trained this model using a vast amount of textbooks are all you need style synthetic datasets as well as some common chat datasets and the Cinder dataset.

Downloads last month
18
Safetensors
Model size
1.1B params
Tensor type
F32
·
Inference API
Unable to determine this model's library. Check the docs .