SyedaArisha/cognita-tinyllama

Cognita — TinyLlama Fine-Tuned for CS Education

A fine-tuned TinyLlama 1.1B model trained on CS teaching conversations, built for Pakistani students learning computer science concepts.

Model Details

• Base model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
• Fine-tuning method: QLoRA (4-bit quantization)
• Training data: 5,030 CS teaching conversations
• Training loss: 2.34 → 0.55
• Hardware: Google Colab T4 GPU

Use Case

Answers computer science questions in a teaching style. Used as the backend for the Cognita Flutter mobile app.

Live Demo

Try it here: https://huggingface.co/spaces/SyedaArisha/cognita

Training Framework

PEFT, BitsAndBytesConfig, Transformers, HuggingFace Trainer

Developer

Syeda Arisha Hassan — COMSATS University Islamabad