YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Statistics Tutor — Llama 3.2 11B Vision

A fine-tuned vision-language model for teaching statistics and probability from elementary to advanced level. Trained on 9,243 multimodal QA pairs from 36 statistics textbooks.

Capabilities

  • Reads textbook pages, handwritten notes, charts, graphs, and formulas
  • Provides hint-based teaching (guides students, doesn't just give answers)
  • Refuses non-statistics questions (built-in guardrails)
  • Explains formulas variable-by-variable
  • Handles both text-only and image+text inputs

Training details

  • Base model: unsloth/Llama-3.2-11B-Vision-Instruct
  • Method: QLoRA (4-bit quantization)
  • Training framework: Unsloth + TRL SFTTrainer
  • Hardware: NVIDIA RTX 4500 Ada (24GB VRAM)
  • Epochs: 3
  • Effective batch size: 16
  • Learning rate: 2e-4 (cosine schedule)
  • LoRA rank: 16, alpha: 32

Dataset

  • 9,243 question-answer pairs (6,470 train / 1,386 val / 1,387 test)
  • Generated using LLaVA 13B from 4,424 textbook page images
  • Sources: 36 statistics textbooks (Statistics Done Wrong, ISLR, etc.)

Usage

Python

from transformers import AutoModelForVision2Seq, AutoProcessor
from PIL import Image
import torch

model = AutoModelForVision2Seq.from_pretrained(
    "Anudeeprao1/stats-tutor-llama3.2-11b",
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
processor = AutoProcessor.from_pretrained("Anudeeprao1/stats-tutor-llama3.2-11b")

# Ask a question
messages = [{
    "role": "user",
    "content": [
        {"type": "image", "image": Image.open("textbook_page.png")},
        {"type": "text",  "text": "Explain this formula step by step"}
    ]
}]

text = processor.apply_chat_template(messages, add_generation_prompt=True)
inputs = processor(text=text, images=Image.open("textbook_page.png"), return_tensors="pt").to("cuda")
output = model.generate(**inputs, max_new_tokens=512)
print(processor.decode(output[0], skip_special_tokens=True))

LM Studio (GUI — no coding)

  1. Download LM Studio
  2. Search: Anudeeprao1/stats-tutor-llama3.2-11b
  3. Download and chat!

System prompt

The model expects this system prompt to be prepended to questions:

You are an expert statistics tutor specializing in teaching statistics and probability. Always give hints first to guide the student toward the answer. Only provide complete solution if explicitly asked. If asked anything NOT related to statistics or probability respond: "I am a statistics tutor and can only help with statistics and probability questions."

Author

Anudeep — fine-tuned for educational research purposes.

License

Apache 2.0

Downloads last month
301
Safetensors
Model size
11B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using Anudeeprao1/stats-tutor-llama3.2-11b 1