Update README.md
Browse files
README.md
CHANGED
@@ -1,12 +1,26 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
## MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization
|
5 |
-
see our paper in https://arxiv.org/abs/2401.06838
|
6 |
|
7 |
-
|
|
|
|
|
|
|
|
|
|
|
8 |
https://github.com/NJUNLP/MAPO
|
9 |
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
## Benchmarks
|
12 |
| System | [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) | [MGSM](https://huggingface.co/datasets/juletxara/mgsm) | [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) |
|
@@ -20,8 +34,8 @@ https://github.com/NJUNLP/MAPO
|
|
20 |
| **[+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-7B)** | **57.4** | **41.6** | **50.4** |
|
21 |
| [MetaMathOctopus 7B](https://huggingface.co/kevinpro/MetaMathOctopus-7B) | 53.0 | 45.5 | 39.2 |
|
22 |
| **[+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-7B)** | **64.7** | **51.6** | **52.9** |
|
23 |
-
| MistralMathOctopus 7B | 59.0 | 58.0 | 56.8 |
|
24 |
-
|
|
25 |
|
26 |
| System | [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) | [MGSM](https://huggingface.co/datasets/juletxara/mgsm) | [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) |
|
27 |
| ------ | :-------------------------------------------------------------: | :------------------------------------------------------: | :-------------------------------------------------------------: |
|
@@ -48,4 +62,4 @@ If you find this model helpful, feel free to cite our paper:
|
|
48 |
archivePrefix={arXiv},
|
49 |
primaryClass={cs.CL}
|
50 |
}
|
51 |
-
```
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
metrics:
|
4 |
+
- accuracy
|
5 |
+
pipeline_tag: text-generation
|
6 |
+
tags:
|
7 |
+
- multilingual
|
8 |
---
|
9 |
## MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization
|
|
|
10 |
|
11 |
+
**🔥Our paper**
|
12 |
+
|
13 |
+
https://arxiv.org/abs/2401.06838
|
14 |
+
|
15 |
+
**🔥Github Project**
|
16 |
+
|
17 |
https://github.com/NJUNLP/MAPO
|
18 |
|
19 |
+
**🔥Open Multilingual Reasoning Leaderboard**
|
20 |
+
|
21 |
+
https://huggingface.co/spaces/kevinpro/Open-Multilingual-Reasoning-Leaderboard
|
22 |
+
|
23 |
+
|
24 |
|
25 |
## Benchmarks
|
26 |
| System | [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) | [MGSM](https://huggingface.co/datasets/juletxara/mgsm) | [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) |
|
|
|
34 |
| **[+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-7B)** | **57.4** | **41.6** | **50.4** |
|
35 |
| [MetaMathOctopus 7B](https://huggingface.co/kevinpro/MetaMathOctopus-7B) | 53.0 | 45.5 | 39.2 |
|
36 |
| **[+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-7B)** | **64.7** | **51.6** | **52.9** |
|
37 |
+
| [MistralMathOctopus 7B](https://huggingface.co/kevinpro/MistralMathOctopus-7B) | 59.0 | 58.0 | 56.8 |
|
38 |
+
| **[+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MistralMathOctopus-MAPO-DPO-7B)** | **74.6** | **67.3** | **70.0** |
|
39 |
|
40 |
| System | [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) | [MGSM](https://huggingface.co/datasets/juletxara/mgsm) | [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) |
|
41 |
| ------ | :-------------------------------------------------------------: | :------------------------------------------------------: | :-------------------------------------------------------------: |
|
|
|
62 |
archivePrefix={arXiv},
|
63 |
primaryClass={cs.CL}
|
64 |
}
|
65 |
+
```
|