komus/physicase_distill_gemma3

---

base_model: google/gemma-3-1b-pt language: en license: apache-2.0

Knowledge Distillation

Model Description

• Teacher Model: google/gemma-3-1b-pt
• Finetuned Teacher Model: komus/physicase_tuned_gemma3
• Student Model: google/gemma-3-270m-it

Training Configuration

• temperature: 2.0
• alpha: 0.5
• gradient_accumulation_steps: 4
• cache_batch_size: 8
• batch_size: 2
• epochs: 3
• max_length: 256

Training Data

• Dataset: Physicase
• Training Samples: 318

Performance

[Include metrics here]