Update README.md
Browse files
README.md
CHANGED
|
@@ -20,8 +20,6 @@ MMSearch-R1-7B is a search-augmented LMM trained with end-to-end reinforcement l
|
|
| 20 |
| Models | MMK12 | MathVerse (testmini) | MathVision (testmini) | MathVista (testmini) | MMMU (val) | AI2D | ChartQA | MME | RealworldQA | OCRBench | DocVQA | MMBench | MMStar | MiaBench |
|
| 21 |
|--------|-------|----------------------|----------------------|----------------------|------------|------|---------|-----|-------------|----------|--------|---------|--------|----------|
|
| 22 |
| Qwen2.5-VL-7B | 34.4 | 46.2 | 24.0 | 66.6 | 49.8 | 93.3 | 94.4 | 630.4/1685.2 | 68.5 | 85.2 | 94.6 | 82.9 | 62.6 | 81.7 |
|
| 23 |
-
| General STEM | 46.2 | 51.4 | 28.4 | 73.6 | 57.3 | 94.4 | 91.4 | 700.7/1662.1 | 67.5 | 83.7 | 92.1 | 83.8 | 65.5 | 76.0 |
|
| 24 |
-
| Reason -> Search | 43.2 | 51.7 | 25.0 | 71.8 | 57.9 | 94.0 | 93.6 | 652.5/1688.3 | 67.5 | 81.7 | 93.5 | 83.2 | 63.1 | 47.6 |
|
| 25 |
| General Search | 43.6 | 52.0 | 27.3 | 74.7 | 56.1 | 94.6 | 94.0 | 718.9/1775.3 | 65.5 | 77.8 | 89.4 | 84.0 | 60.4 | 44.4 |
|
| 26 |
|
| 27 |
---
|
|
@@ -30,7 +28,6 @@ MMSearch-R1-7B is a search-augmented LMM trained with end-to-end reinforcement l
|
|
| 30 |
|--------|----------|----------|------|-----------|
|
| 31 |
| Qwen2.5-VL-7B | 20.1 | 12.8 | 20.3 | 38.4 |
|
| 32 |
| MMSearch | 55.1 | 53.8 | 58.4 | 57.4 |
|
| 33 |
-
| Reasoning -> Search | 58.5 | 57.1 | 57.9 | 57.7 |
|
| 34 |
| General Search | 52.0 | 54.9 | 52.8 | 57.0 |
|
| 35 |
|
| 36 |
### Training Details
|
|
|
|
| 20 |
| Models | MMK12 | MathVerse (testmini) | MathVision (testmini) | MathVista (testmini) | MMMU (val) | AI2D | ChartQA | MME | RealworldQA | OCRBench | DocVQA | MMBench | MMStar | MiaBench |
|
| 21 |
|--------|-------|----------------------|----------------------|----------------------|------------|------|---------|-----|-------------|----------|--------|---------|--------|----------|
|
| 22 |
| Qwen2.5-VL-7B | 34.4 | 46.2 | 24.0 | 66.6 | 49.8 | 93.3 | 94.4 | 630.4/1685.2 | 68.5 | 85.2 | 94.6 | 82.9 | 62.6 | 81.7 |
|
|
|
|
|
|
|
| 23 |
| General Search | 43.6 | 52.0 | 27.3 | 74.7 | 56.1 | 94.6 | 94.0 | 718.9/1775.3 | 65.5 | 77.8 | 89.4 | 84.0 | 60.4 | 44.4 |
|
| 24 |
|
| 25 |
---
|
|
|
|
| 28 |
|--------|----------|----------|------|-----------|
|
| 29 |
| Qwen2.5-VL-7B | 20.1 | 12.8 | 20.3 | 38.4 |
|
| 30 |
| MMSearch | 55.1 | 53.8 | 58.4 | 57.4 |
|
|
|
|
| 31 |
| General Search | 52.0 | 54.9 | 52.8 | 57.0 |
|
| 32 |
|
| 33 |
### Training Details
|