Entropy-Aware On-Policy Distillation of Language Models
Paper • 2603.07079 • Published • 1
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
qwen2.5-7b-eopd-tooluse
Entropy-Aware On-Policy Distillation of Language Models (EOPD):
Student is qwen2.5-7b-instruct and teacher model is qwen2.5-32b-instruct
Trained on Tooluse dataset, split released with Self-Distillation Fine-tuning (SDFT): https://github.com/idanshen/Self-Distillation/tree/main
Model scored 53.6% on the evaluation set
- Downloads last month
- 39
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support