Model Description
The model you’re using is based on Qwen/Qwen2.5-0.5B-Instruct, a powerful AI designed to follow instructions across a wide range of tasks. Through specialized fine-tuning, this model has been trained to become highly proficient in solving complex mathematical problems. By using a dataset specifically focused on math (Augmentation-Scaling-Laws/math-seed-data), it has gained the ability to handle advanced calculations and mathematical reasoning, making it an ideal assistant for anyone needing help with math-related tasks or challenges.
- Developed by: Youri Lalain (@Youlln)
- Organization: ECE engineering school
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 7.44 |
| IFEval (0-Shot) | 25.26 |
| BBH (3-Shot) | 7.63 |
| MATH Lvl 5 (4-Shot) | 1.21 |
| GPQA (0-shot) | 2.24 |
| MuSR (0-shot) | 0.89 |
| MMLU-PRO (5-shot) | 7.40 |
- Downloads last month
- 157
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
Model tree for Youlln/ECE-Qwen0.5B-FT-V2
Base model
Qwen/Qwen2.5-0.5B
Finetuned
Qwen/Qwen2.5-0.5B-Instruct
Dataset used to train Youlln/ECE-Qwen0.5B-FT-V2
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard25.260
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard7.630
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard1.210
- acc_norm on GPQA (0-shot)Open LLM Leaderboard2.240
- acc_norm on MuSR (0-shot)Open LLM Leaderboard0.890
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard7.400