Model Card for Mathstral-7B-v0.1
Mathstral 7B is a model specializing in mathematical and scientific tasks, based on Mistral 7B. You can read more in the official blog post.
Installation
Step 1: Download RAGNA Desktop
Step 2: Download this quantized model.
Chat
After installing
You can then start chatting with the model, e.g. prompt it with something like:
"Albert likes to surf every week. Each surfing session lasts for 4 hours and costs $20 per hour. How much would Albert spend in 5 weeks?"
Evaluation
We evaluate Mathstral 7B and open-weight models of the similar size on industry-standard benchmarks.
| Benchmarks | MATH | GSM8K (8-shot) | Odyssey Math maj@16 | GRE Math maj@16 | AMC 2023 maj@16 | AIME 2024 maj@16 |
|---|---|---|---|---|---|---|
| Mathstral 7B | 56.6 | 77.1 | 37.2 | 56.9 | 42.4 | 2/30 |
| DeepSeek Math 7B | 44.4 | 80.6 | 27.6 | 44.6 | 28.0 | 0/30 |
| Llama3 8B | 28.4 | 75.4 | 24.0 | 26.2 | 34.4 | 0/30 |
| GLM4 9B | 50.2 | 48.8 | 18.9 | 46.2 | 36.0 | 1/30 |
| QWen2 7B | 56.8 | 32.7 | 24.8 | 58.5 | 35.2 | 2/30 |
| Gemma2 9B | 48.3 | 69.5 | 18.6 | 52.3 | 31.2 | 1/30 |
- Downloads last month
- 12