Longhui98 commited on
Commit
e634cdc
1 Parent(s): b6e5e3c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -8,6 +8,13 @@ see our paper in https://arxiv.org/abs/2309.12284
8
  View the project page:
9
  https://meta-math.github.io/
10
 
 
 
 
 
 
 
 
11
  ## Model Details
12
 
13
  MetaMath-Llemma-7B is fully fine-tuned on the MetaMathQA datasets and based on the powerful Llemma-7B model. It is glad to see using MetaMathQA datasets and change the base model from llama-2-7B to Llemma-7B can boost the MATH performance from 19.8 to **30.0**.
 
8
  View the project page:
9
  https://meta-math.github.io/
10
 
11
+ ## Note
12
+
13
+ All MetaMathQA data are augmented from the training sets of GSM8K and MATH.
14
+ <span style="color:red"><b>None of the augmented data is from the testing set.</b></span>
15
+
16
+ You can check the `original_question` in `meta-math/MetaMathQA`, each item is from the GSM8K or MATH train set.
17
+
18
  ## Model Details
19
 
20
  MetaMath-Llemma-7B is fully fine-tuned on the MetaMathQA datasets and based on the powerful Llemma-7B model. It is glad to see using MetaMathQA datasets and change the base model from llama-2-7B to Llemma-7B can boost the MATH performance from 19.8 to **30.0**.