NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language Models (2024)

Abstract: Numeral systems and units of measurement are two conjoined topics in activities of human beings and have mutual effects with the languages expressing them. Currently, the evaluation of Large Language Models (LLMs) often involves mathematical reasoning, yet little attention is given to how minor changes in numbers or units can drastically alter the complexity of problems and the performance of LLMs. In this paper, we scrutinize existing LLMs on processing of numerals and units of measurement by constructing datasets with perturbations. We first anatomize the reasoning of math word problems to different subprocedures like numeral conversions from language to numbers and measurement conversions based on units. Then we further annotate math word problems from ancient Chinese arithmetic works which are challenging in numerals and units of measurement. Experiments on perturbed datasets demonstrate that LLMs still encounter difficulties in handling numeral and measurement conversions. The code and data are available at: https://github.com/CASSIAT-ConsistencyAI/NUMCoT.

heading: 1 Introduction
text: Numbers and counting are the basic concepts in human experience. Numbers are a set of conceptual tools made from words and other symbols for specific quantities and a key set of linguistically based innovations that distinguish human species from others (Everett, 2017). The development of numeral systems allows humans to express numbers in a consistent manner.1 Counting is usually not a monotone process of manipulating numbers from a numeral system but to quantify objects with a units of measurement2 to compare the magnitude.
∗Corresponding author. 1https://en.wikipedia.org/w/index.php? title=Numeral_system 2https://en.wikipedia.org/w/index.php? title=Unit_of_measurement
In the literature, Thawani et al. (2021) adopt the taxonomy discipline called Core Systems of Number (Feigenson et al., 2004) from cognitive science. The tasks in numeracy are then categorized by the granularity and units attached to the quantities in the task, where granularity means whether the encoding of the number is exact or approximate, and units represent whether the numerals are in their numerical forms or grounded with units of measurement. Based on the taxonomy, existing numeracyoriented tasks are identified as simple arithmetic tasks (Wang et al., 2021), numeration tasks (Naik et al., 2019; Wallace et al., 2019; Johnson et al., 2020), magnitude comparison tasks (Naik et al., 2019; Wallace et al., 2019), Math Word Problems (MWPs) (Roy and Roth, 2015; Wang et al., 2017; Amini et al., 2019), exact facts in the context of numeracy (Lin et al., 2020; Mishra et al., 2020), measurement estimation tasks (Forbes and Choi, 2017; Elazar et al., 2019; Zhou et al., 2020) and numerical language modeling tasks. There are still tasks which fall out the taxonomy, such as numeric paraphrasing (one-to-one correspondences between different surface forms of the same number), quantity entailment tasks (Mishra et al., 2020), numeral understanding tasks, Fused-Head Resolution, counting tasks (Suzgun et al., 2019; Bhattamishra et al., 2020) and other domain-specific tasks. As far as we are concerned, the tasks discussed above cover a wide range of topics in numeracy and address a lot of challenges faced by numerals and units of measurement.
However, we still need to address the issue of numeracy when discussing arithmetic by using pure numerals and making an extra effort to take units of measurement into consideration. The inadequacy in accurately converting numerals with units of measurement may lead to unpredictable consequences in real-life scenarios, especially in the era of Large Language Models (LLMs) where decoderonly generation methods are being employed.
14268
Conventional LLMs (Workshop, 2023; OpenAI, 2023; Zeng et al., 2023; Touvron et al., 2023a) implicitly assume that numeral systems and units of measurement are innate, and they conduct analysis at the reasoning level to demonstrate their ability in solving math word problems. For example, Wei et al. (2023) uses Chain-of-Thought method to prompt LLMs to generate coherent series of intermediate reasoning steps to solve problems. We argue that this assumption needs further verification, and better prompting methods are also needed to explore the extent to which the assumption actually works. In a math word problem, if the conversion of numerals or scale of units fails, it’s not guaranteed to be correct, even if each further reasoning step is on the right track. We justify our claim from the following aspects: (1) In LLMs, the extrapolation of numerals is more difficult to define, as the numbers in the training set have a wider range compared to traditional models. (2) Although most math word problems adopt the Hindu-Arabic writing style for numerals, it’s still common to use pronunciations with written style to mark a number for the advantage of being irrevocable, especially in Chinese. When writing Arabic numerals, we often overlook the magnitude and only focus on the length of the numerals. However, the rules for reading numbers are very different. For example, in English, every three digits are divided into a scale, while in Chinese, it is every four digits. When pronouncing, we first focus on the length of the numbers, then on the magnitude, and finally group and read them one by one. (3) To our best knowledge, the investigation on units of measurement has been conducted through measuring skill tests (unit conversion, reference range detection, and measure comparison) (Park et al., 2022) with pretrained language models and has identified their lack of such abilities. It is still unknown to what extent LLMs can overcome this challenge, especially in uniting numeral conversions with units of measurement. To achieve these goals, we construct four datasets to synthesize the procedure of how humans process numerals and units of measurement. The procedure is anatomized into sub-procedures like converting words into numbers, dealing with units of measurement with different scales and solving the problem using reasoning and rationale. For each sub-procedure, we employ random numbers and addition operations to perturb the dataset, thereby reducing the generation of memorization issues.
In this paper, we focus on ChatGPT (OpenAI, 2022), ChatGLM series models (Zhipu.AI, 2023)
, ERNIE-Bot (Baidu, 2023) and LLaMA-2 family models (Touvron et al., 2023b). We construct different prompts to elicit LLMs to generate responses for the datasets above. Our experiments reveal that LLMs exhibit robustness in converting between numbers and English text, but less effectiveness in converting between numbers and Chinese text.
Furthermore, LLMs consistently struggle to memorize conversion ratios between different units, posing challenges for automatic numeral conversions based on unit changes. In MWPs involving numeral conversions and units of measurement, LLMs perform well. However, LLMs often struggle to provide correct answers to SUANJING problems that require specialized long-tail knowledge.
In summary, our work makes the following contributions:
1. We construct four datasets to explore the performance of LLMs in tasks that involve numeral conversions and unit conversion, which are crucial research questions for LLMs.
2. We discover and verify that introducing CoT in certain subtasks significantly deteriorates the reasoning performance of LLMs. In the experimental section, we provide the corresponding analysis.
3. We conduct prompt-based experiments on LLMs to assess their ability in numeral conversions and units of measurement, thereby highlighting a new direction for training and benchmarking LLMs.

heading: 2 Related Work

heading: 2.1 Units of Measurement in Numeracy
text: Units of measurement in numeracy have been attracting attention from the community because of their relationship with common sense in life and domain knowledge in applications. Despite recent success of pre-trained language models (PLMs) (Devlin et al., 2019; Liu et al., 2020), their reasoning abilities using numerical commonsense is surprisingly poor (Lin et al., 2020) and PLMs lack the capability required for reasoning over measurements (Park et al., 2022). The knowledge on scaling of measurement, such as 1000 meters make a km, can add extra challenge to numerical reasoning tasks (Mishra et al., 2022).
While traditional explorations over measurements address more on quantity identification with
measurements (Harper et al., 2021; Göpfert et al., 2022) and their comparable properties (Forbes and Choi, 2017; Lin et al., 2020; Park et al., 2022), we focus more on the accuracy of their usage from arithmetic perspective. With the development of CoT-based approaches in LLMs, we are also curious how they perform on dealing with different system of units in either base forms and derived forms.

heading: 2.2 Numeracy in Large Language Models
text: Besides the survey conducted by Thawani et al. (2021) that is mentioned in Section 1, we also review how numeracy is discussed in the era of LLMs. The evaluation of GPT-3 (Brown et al., 2020) over NumGLUE (Mishra et al., 2022) indicates that it is a better few-shot learner but not necessarily a better many-shot learner. In arithmetic, MathGLM (Yang et al., 2023) breaks the misconception that LLMs are unable to accurately perform arithmetic operations and trains a model which can accurately perform multi-digit arithmetic operations with almost 100% accuracy without data leakage, significantly surpassing GPT-4 (OpenAI, 2023).

heading: 3 Datasets and Perturbations

heading: 3.1 Datasets
text: For math word problems using different numeral systems and units of measurement, we are curious about how LLMs process such information in their reasoning steps. We choose to anatomize the reasoning of math word problems into different sub-procedures, like conversions between numbers and words, conversions with units of measurement. We first build the Numeral Conversions dataset and the Conversions with Units of Measurement dataset. Then we construct the Cross Lingual MWPs dataset that involves math word problems with Chinese and English, and the SUANJING dataset abundant with these challenges. The datasets are illustrated in Figure 1.
Numeral Conversions The conversion of numerals to words (Num2Words) and its inverse process Words2Num are two basic abilities for humans to manipulate numbers. Pronunciation of numerals is critical for humans to express quantities precisely. For example, an integer 21,600,900 should be pronounced as “twenty one million six hundred thousand nine hundred only" in English and “二千一百 六十万零九百" in Chinese. The task is also called
as (Numeric) Paraphrasing (Thawani et al., 2021). The practice using text conversion from numerical to standard spelled-out numbers in numeracy probing has been conducted earlier in other multilingual numerical understanding works (Johnson et al., 2020).
Different from them, where numbers are generated from a smaller range of 0 to 999, we generate numbers from 0 to trillions and consider the complexity of each number from both scale and pronunciation forms. The Numeral Conversions dataset is separated into the following splits:
1. The Numeral Conversions Medium split consists of 400 randomly generated integers falling into the ranges of zero to a thousand (0- 1K), a thousand to a million (1K-1M), a million to a billion (1M-1B), and a billion to a trillion (1B-1T), with each range containing 100 integers.
2. The Numeral Conversions Easy split comprises 400 Arabic numerals with lengths identical to those in the Numeral Conversions Medium split, but the corresponding pronunciation forms in Chinese and English are significantly shorter.
3. The Numeral Conversions Hard split consists of 200 fractions and 200 decimals. For fractions, the numerators and denominators of the fractions are randomly sampled from the same four numerical ranges mentioned earlier, ensuring they are of similar scales. Two random integers, A and B, are generated within their respective numerical range, forming a fraction in the format A/B . Similarly, two random integers, C and D, are selected within their corresponding numerical range, composing a decimal in the format C.D .
Conversions with Units of Measurement In most human experiences, numbers are used in joint with units of measurement to express real-world quantities. In specific scenarios, units of measurement with different scales are also ubiquitous. For example, 1.5 litre is equivalent to 1 litre plus 500 milliliters. However, it’s still questionable whether LLMs process such information similarly as humans.
To emphasize this sub-procedure, we create parallel datasets in both Chinese and English based on 18 units commonly used by humans, such as length,
time, weight, and money, including centimeters, seconds, kilograms, yuan, and other units. These datasets are generated using random numbers and are identical in all aspects except for the language. Additionally, we categorize the questions into three levels of difficulty.
1. The Units of Measurement Easy split involves the conversion of numerical values from one unit to another. For example, 856 grams = ? milligrams.
2. The Units of Measurement Medium split requires performing addition or subtraction between two units before converting to another unit. For example, 738 seconds - 5 milliseconds = ? milliseconds.
3. The Units of Measurement Hard split involves a more complex process: combining two units into one and then performing addition or subtraction operations before converting to another unit. For example, 4 days 387 hours + 81 days = ? days ? hours.
LLMs require common sense and reasoning abilities to complete conversions at all three levels.
MWPs and SUANJING To compare the challenges introduced by numeral conversions and units of measurement, we utilize a bilingual MWPs dataset redacted by Tan et al. (2022) and a Chinese dataset SUANJING translated from ancient Chinese MWPs. The bilingual MWPs dataset is compiled from AddSub (Hosseini et al., 2014), SingleOp (Roy et al., 2015) and MultiArith (Roy and Roth, 2015), containing 1557 elementary school math word problems.
SUANJING problems are constructed by translating ancient Chinese to modern Chinese while preserving character-level numeral representations. We select SUANJING because it comprehensively tests LLMs on tasks like Num2Words, Words2Num, and Conversations with Units of Measurement. This setup allows us to examine LLMs’ performance under various conditions: without CoT, with CoT but lacking rare knowledge, and with CoT plus rare knowledge. The translation is performed by ChatGLM-6B (Du et al., 2022; Zeng et al., 2022) and further refined by human experts. We list details about SUANJING in Appendix A.
Num2Words Words2Num
Zero-shot Zero-shot CoT Few-shot Few-shot CoT Zero-shot Zero-shot CoT Few-shot Few-shot CoT
ZH EN ZH EN ZH EN ZH EN ZH EN ZH EN ZH EN ZH EN
ChatGLM-6B 28.75 6.50 22.75 1.50 20.00 7.75 7.00 4.50 75.50 50.25 59.75 40.25 70.25 45.75 55.50 32.50
ERNIE-Bot-turbo 39.00 12.25 28.50 8.75 48.25 44.75 33.25 36.75 74.75 57.00 66.25 29.50 87.00 67.75 76.00 51.00
ChatGLM-Turbo 39.25 41.75 38.75 35.25 45.75 42.00 32.25 30.00 80.50 61.25 53.00 40.00 88.50 73.50 62.50 38.50
Llama2-7B 12.50 18.50 9.50 12.75 21.50 44.75 7.50 23.75 27.00 30.50 14.00 28.25 39.00 68.50 17.00 29.75
Llama2-13B 19.50 37.00 7.75 15.00 33.00 52.75 4.25 17.50 27.00 20.50 13.25 10.50 62.50 76.50 33.75 31.50
Llama2-70B 32.75 45.50 8.25 17.25 33.00 54.75 6.50 48.50 38.00 62.75 27.00 21.00 38.75 67.75 19.75 23.75
ChatGPT 68.00 98.25 54.25 90.25 72.50 99.25 57.25 96.50 61.25 100.00 45.75 68.00 63.75 99.75 58.50 89.00

heading: 4.1 The Accuracy of Numeral Conversions

heading: 4 Experiments

heading: 3.2 Perturbations
text: that of ChatGPT. However, as the scale of numbers increases, there is a consistent decrease in accuracy for all models. The comparison is shown in Figure 2a.
ChatGPT over Different Scales Given that ChatGPT performs exceptionally well among other models, we further analyze ChatGPT as the representative model. For data related to other models, please refer to Table 14 to 15 in the Appendix.We illustrate how ChatGPT performs across different scales from the following aspects: (1) Complexity: As the decoding length for ChatGPT increases from Easy to Hard difficulty, the accuracy decreases consistently across all scales, see Figure 2b. (2) Prompt Method: Figure 2c shows that the inclusion of CoT in Zero-shot harms performance across all scales while Few-shot works better for large scales. (3) Language: As both Chinese and English have relative high number system transparency (Johnson et al., 2020), the gaps between two languages is surprising, see Figure 2d. This partially shows that either training corpus is skewed
or numeral conversions knowledge is less transferable across languages.

heading: 4.2 Evaluation of Numerals with Units of Measurement
text: In the experiment concerning units of measurement, we adopt the same prompt design as in the previous experiment. To further investigate the impact of unit conversion knowledge on the reasoning capabilities of LLMs in this experiment, we define Few-shot CoT with knowledge that involves the addition of necessary unit conversion knowledge to the Few-shot CoT framework. For all prompt designs regarding units of measurement, please refer to Table 11 in the appendix.
The Table 2 is experimental results of the seven models across datasets of three different difficulty levels. The results clearly demonstrate that (1) ChatGPT, compared to other models, consistently exhibits superior performance and reasoning capabilities across all levels of dataset difficulty and in both languages. (2) Unlike the previous
MWPs SUANJING
Zero-shot Zero-shot CoT Few-shot Few-shot CoT Zero-shot Zero-shot
CoT Few-shot
Few-shot
CoT
Few-shot CoT
with knowledge
ZH EN ZH EN ZH EN ZH EN ZH ZH ZH ZH ZH
ChatGLM-Turbo 82.98 87.48 87.80 93.32 59.86 70.13 88.18 93.9 8.00 6.50 2.50 2.00 5.00
ChatGPT 83.75 92.68 86.90 93.26 77.01 85.74 88.38 95.31 5.50 9.00 2.00 5.50 8.00
Llama2-70B 82.08 91.91 81.95 90.75 81.63 91.78 81.18 90.11 0.00 0.00 0.00 0.00 0.00

heading: 4.4 Analysis of Errors from LLMs

heading: 4.3 Comparisons over MWPs and SUANJING
text: recognize its significance and inability to accurately restore the quantity and position of zero in the numerical context. To enhance the accuracy of LLMs in such tasks, future improvements could focus on refining LLMs’ ability to recognize the length and magnitude of numbers.
Our experiments also demonstrated that CoT did not work in the numeral conversion experiments. LLMs achieved significantly higher accuracy rates on the easy dataset, which was of comparable scale to the medium dataset but required shorter answer lengths. This discrepancy highlights two main challenges that LLMs face in numerical reasoning. First, the linguistic nature of input text makes it difficult for LLMs to understand numerical data. Second, the flexibility and complexity of the answers increase the likelihood of errors in longer outputs. Given that CoT primarily enhances performance on complex inference tasks rather than simple ones, its application to simpler tasks such as Num2Words and Words2Num increases the length of the generated text, thereby diminishing LLMs accuracy.
In the units of measurement experiment, the majority of errors primarily stem from LLMs’ failure to correctly recognize the conversion magnitude relationship when multiple units are involved. As
depicted in the figure 4b, there exists a tenfold progressive relationship between decimeters and centimeters, yet LLMs overlook the magnitude relationship inherent in textual units. Introducing CoT significantly mitigates the occurrence of such errors but still requires further refinement. Additionally, even when LLMs have correctly grasped the magnitude relationship inherent in textual units, errors may still occur during the calculation process. To enhance the accuracy of LLMs in such tasks, efforts could be directed towards improving LLMs’ recognition of textual units and the magnitude relationships between units.
In the SUANJING experiment, LLMs face more comprehensive problem-solving tasks. As depicted in the figure 5, LLMs encounter errors in handling units in SUANJING problems, as some ancient units are extremely rare in contemporary society, making it difficult for LLMs to correctly understand SUANJING problems. This long tail problem can be addressed by introducing external knowledge in the prompt, thereby enabling LLMs to have a chance of correctly handling SUANJING problems. However, LLMs frequently make errors in recognizing numbers and performing numerical calculations, especially in the recognition and computation of more challenging fractions and decimals.
要计算这块田的面积，我们可以使用矩形的面积公式： 面积 = 宽度 × 长度。根据题目，田的宽度是五分之四 步，长度是九分之五步。
所以，田的面积可以计算如下：面积 = 五分之四步 × 九分之五步。首先我们需要将五分之四和九分之五化为 小数形式。五分之四 = 5/4 = 1.25，九分之五 = 9/5 = 1.8。
然后我们可以计算面积：面积 = 1.25步 × 1.8步 = 2.25步。所以，这块田的面积是2.25步。
还有一块田，它的宽是五分之四步，长是九分之五步，问 这田的面积是多少？
要计算田的面积，我们可以使用公式：面积=长 × 宽。 根据题目，田的宽是十二步，长是十四步。
所以，面积=10 × 12 = 140步，由于1亩=240步，所以 140步又等于0.583亩，即0.583亩。
（需要注意到，1亩=240步）
又有一块田，它的宽是十二步，长是十四步。问：这田的 面积是多少？

heading: 5 Conclusion
text: 1. There is a noticeable performance gap between Chinese LLMs and top-tier models like ChatGPT.
2. The same large language model exhibits varying levels of performance facing problems in different languages.
3. Despite the introduction of external knowledge and CoT, LLMs still struggle to effectively handle comprehensive problems involving numeral conversions and units of measurement.
Limitations
In this paper, we introduce datasets to investigate whether LLMs can process numeral conversions and units of measurement like humans, despite certain limitations.
Firstly, LLMs’ responses exhibit randomness,

heading: Acknowledgements
text: word problem solving with operation-based formalisms. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2357–2367, Minneapolis, Minnesota. Association for Computational Linguistics.
Baidu. 2023. Introducing ernie-bot. http: //research.baidu.com/Blog/ index-view?id=185.
Satwik Bhattamishra, Arkil Patel, and Navin Goyal. 2020. On the computational power of transformers and its implications in sequence modeling. In Proceedings of the 24th Conference on Computational Natural Language Learning, pages 455–475, Online. Association for Computational Linguistics.
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners.
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics.
Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, and Jie Tang. 2022. GLM: General language model pretraining with autoregressive blank infilling. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 320–335, Dublin, Ireland. Association for Computational Linguistics.
Yanai Elazar, Abhijit Mahabal, Deepak Ramachandran, Tania Bedrax-Weiss, and Dan Roth. 2019. How large are lions? inducing distributions over quantitative attributes. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3973–3983, Florence, Italy. Association for Computational Linguistics.
C. Everett. 2017. Numbers and the Making of Us: Counting and the Course of Human Cultures. Harvard University Press.
Lisa Feigenson, Stanislas Dehaene, and Elizabeth Spelke. 2004. Core systems of number. Trends in Cognitive Sciences, 8(7):307–314.
Maxwell Forbes and Yejin Choi. 2017. Verb physics: Relative physical knowledge of actions and objects. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 266–276, Vancouver, Canada. Association for Computational Linguistics.
Jan Göpfert, Patrick Kuckertz, Jann Weinand, Leander Kotzur, and Detlef Stolten. 2022. Measurement extraction with natural language processing: A review. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 2191–2215, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Corey Harper, Jessica Cox, Curt Kohler, Antony Scerri, Ron Daniel Jr., and Paul Groth. 2021. SemEval-2021 task 8: MeasEval – extracting counts and measurements and their related contexts. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 306–316, Online. Association for Computational Linguistics.
Mohammad Javad Hosseini, Hannaneh Hajishirzi, Oren Etzioni, and Nate Kushman. 2014. Learning to solve arithmetic word problems with verb categorization. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 523–533, Doha, Qatar. Association for Computational Linguistics.
Devin Johnson, Denise Mak, Andrew Barker, and Lexi Loessberg-Zahl. 2020. Probing for multilingual numerical understanding in transformer-based language models. In Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, pages 184–192, Online. Association for Computational Linguistics.
Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, and Xiang Ren. 2020. Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of PreTrained Language Models. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6862–6868, Online. Association for Computational Linguistics.
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Ro{bert}a: A robustly optimized {bert} pretraining approach.
Swaroop Mishra, Arindam Mitra, Neeraj Varshney, Bhavdeep Sachdeva, and Chitta Baral. 2020. Towards question format independent numerical reasoning: A set of prerequisite tasks.
Swaroop Mishra, Arindam Mitra, Neeraj Varshney, Bhavdeep Sachdeva, Peter Clark, Chitta Baral, and Ashwin Kalyan. 2022. NumGLUE: A suite of fundamental yet challenging mathematical reasoning tasks. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3505–3523, Dublin, Ireland. Association for Computational Linguistics.
Aakanksha Naik, Abhilasha Ravichander, Carolyn Rose, and Eduard Hovy. 2019. Exploring numeracy in word embeddings. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3374–3380, Florence, Italy. Association for Computational Linguistics.
OpenAI. 2022. Introducing chatgpt. https:// openai.com/blog/chatgpt.
OpenAI. 2023. Gpt-4 technical report.
Sungjin Park, Seungwoo Ryu, and Edward Choi. 2022. Do language models understand measurements? In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 1782–1792, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Subhro Roy and Dan Roth. 2015. Solving general arithmetic word problems. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1743–1752, Lisbon, Portugal. Association for Computational Linguistics.
Subhro Roy, Tim Vieira, and Dan Roth. 2015. Reasoning about quantities in natural language. Transactions of the Association for Computational Linguistics, 3:1–13.
Mirac Suzgun, Yonatan Belinkov, Stuart Shieber, and Sebastian Gehrmann. 2019. LSTM networks can perform dynamic counting. In Proceedings of the Workshop on Deep Learning and Formal Languages: Building Bridges, pages 44–54, Florence. Association for Computational Linguistics.
Minghuan Tan, Lei Wang, Lingxiao Jiang, and Jing Jiang. 2022. Investigating math word problems using pretrained multilingual language models. In Proceedings of the 1st Workshop on Mathematical Natural Language Processing (MathNLP), pages 7–16, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Avijit Thawani, Jay Pujara, Filip Ilievski, and Pedro Szekely. 2021. Representing numbers in NLP: a survey and a vision. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 644–656, Online. Association for Computational Linguistics.
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023a. Llama 2: Open foundation and fine-tuned chat models.
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller,
Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023b. Llama: Open and efficient foundation language models.
Eric Wallace, Yizhong Wang, Sujian Li, Sameer Singh, and Matt Gardner. 2019. Do NLP models know numbers? probing numeracy in embeddings. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5307–5315, Hong Kong, China. Association for Computational Linguistics.
Cunxiang Wang, Boyuan Zheng, Yuchen Niu, and Yue Zhang. 2021. Exploring generalization ability of pretrained language models on arithmetic and logical reasoning. In Natural Language Processing and Chinese Computing, pages 758–769, Cham. Springer International Publishing.
Yan Wang, Xiaojiang Liu, and Shuming Shi. 2017. Deep neural solver for math word problems. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 845–854, Copenhagen, Denmark. Association for Computational Linguistics.
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. 2023. Chain-of-thought prompting elicits reasoning in large language models.
BigScience Workshop. 2023. Bloom: A 176bparameter open-access multilingual language model.
Zhen Yang, Ming Ding, Qingsong Lv, Zhihuan Jiang, Zehai He, Yuyi Guo, Jinfeng Bai, and Jie Tang. 2023. Gpt can solve mathematical problems without a calculator.
Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, Weng Lam Tam, Zixuan Ma, Yufei Xue, Jidong Zhai, Wenguang Chen, Zhiyuan Liu, Peng Zhang, Yuxiao Dong, and Jie Tang. 2023. GLM-130b: An open bilingual pre-trained model. In The Eleventh International Conference on Learning Representations.
Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu,

heading: A SUANJING Dataset
text: To facilitate the evaluation of reasoning integrating all sub-procedures, we need a dataset with challenges discussed above. We construct SUANJING (算经) by extracting and annotating math word problems from a collection of ancient Chinese algorithmic books.
Although grammars and lexicons of the Chinese language endure great changes in history, the numeral systems and units of measurement are reserved and still used in daily life. Especially in formal documents and statements of financial institutions, the representation of numerals are required to be written in both traditional style8 and
8https://en.wikipedia.org/w/index.php? title=Chinese_numerals
9https://en.wikipedia.org/w/index.php? title=Li_Chunfeng
10https://en.wikipedia.org/w/index.php? title=Ten_Computational_Canons
Prompt that convert integer into English in Num2Words
Zero-shot The following is a question about how to convert integers into English pronunciation. Please provide the correct answer based on the numbers in the question.
Question:XXX Answer:
Zero-shot CoT The following is a question about how to convert integers into English pronunciation. Please provide the correct answer based on the numbers in the question.
Question:XXX Answer: Let's think step by step,
Few-shot
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123 Answer: One hundred twenty-three
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123456 Answer: One hundred twenty-three thousand four hundred fifty-six
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question:

heading: 123456789 Answer: One hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine
text: The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question:

heading: 123456789012 Answer: One hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve
text: The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question:

heading: XXX Answer:
text: Few-shot CoT
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123 Answer: Let's think step by step, 1. The length of this integer is 3 digits, which in English grammar is a number at the hundred level; 2. From high to low, each level of this number reads as: one hundred, twenty, three; 3. From left to right, it can be written as one hundred twenty-three. So, the answer is one hundred twenty-three.
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123456 Answer: Let's think step by step, 1. The length of this integer is 6 digits, which in English grammar is a number at the hundred thousand level; 2. From high to low, each level of this number reads as: one hundred thousand, twenty thousand, three thousand, four hundred, fifty, six; 3. From left to right, it can be written as one hundred twenty-three thousand four hundred fifty-six. So, the answer is one hundred twenty-three thousand four hundred fifty-six.
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123456789 Answer: Let's think step by step, 1. The length of this integer is 9 digits, which in English grammar is a number at the hundred million level; 2. From high to low, each level of this number reads as: one hundred million, twenty million, three million, four hundred thousand, fifty thousand, six thousand, seven hundred, eighty, nine; 3. From left to right, it can be written as one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine. So, the answer is one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine.
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question: 123456789002 Answer: Let's think step by step, 1. The length of this integer is 12 digits, which in English grammar is a number at the hundred billion level; 2. From high to low, each level of this number reads as: one hundred billion, twenty billion, three billion, four hundred million, fifty million, six million, seven hundred thousand, eighty thousand, nine thousand, zero, zero, two; 3. From left to right, it can be written as one hundred and twenty-three billion four hundred and fifty-six million seven hundred and eighty-nine thousand and two. So, the answer is one hundred and twenty-three billion four hundred and fifty-six million seven hundred and eighty-nine thousand and two.
The following are questions about converting integers into their English reading forms. Please give the correct answers based on the numbers in the questions. Question:

heading: XXX Answer: Let's think step by step,
text: Prompt that convert decimal into English in Num2Words
Zero-shot The following is a question about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question.
Question:XXX Answer:
Zero-shot CoT The following is a question about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question.
Question:XXX Answer: Let's think step by step,
Few-shot
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:123.456 Answer: one hundred twenty three point four five six.
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: 123456.789012 Answer: one hundred twenty three thousand four hundred fifty six point seven eight nine zero one two.
text: The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: 123456789.987654321 Answer: one hundred twenty three million four hundred fifty six thousand seven hundred eighty nine point nine eight seven six five four three two one.
text: The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: 123456789012.210987654321 Answer: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve point two one zero nine eight seven six five four three two one.
text: The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: XXX Answer:
text: Few-shot CoT
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:123.456 Answer: Let's think step by step, 1. This number has a decimal point, so it's a decimal.2. The integer part to the left of the decimal point is 123, which is a 3-digit integer. According to English grammar, a 3-digit number is at the hundred level.3. So, the integer part from left to right can be written as one hundred twenty three.4. The decimal part to the right of the decimal point is 456, which according to English grammar, is written out one digit at a time.5. So the decimal part from left to right can be written as four five six.6. The decimal point is read as 'point'.So the answer is one hundred twenty three point four five six.
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question: 123456.789012 Answer: Let's think step by step, 1. This number has a decimal point, so it's a decimal.2. The integer part to the left of the decimal point is 123456, which is a 6- digit integer. According to English grammar, a 6-digit number is at the hundred-thousand level.3. So, the integer part from left to right can be written as one hundred twenty three thousand four hundred fifty six.4. The decimal part to the right of the decimal point is 789012, which according to English grammar, is written out one digit at a time.5. So the decimal part from left to right can be written as seven eight nine zero one two.6. The decimal point is read as 'point'.So the answer is one hundred twenty three thousand four hundred fifty six point seven eight nine zero one two.
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question: 123456789.987654321 Answer: Let's think step by step, 1. This number has a decimal point, so it's a decimal.2. The integer part to the left of the decimal point is 123456789, which is a 9-digit integer. According to English grammar, a 9-digit number is at the hundred-million level.3. So, the integer part from left to right can be written as one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine.4. The decimal part to the right of the decimal point is 987654321, which according to English grammar, is written out one digit at a time.5. So the decimal part from left to right can be written as nine eight seven six five four three two one.6. The decimal point is read as 'point'.So the answer is one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine point nine eight seven six five four three two one.
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: 123456789012.210987654321 Answer: Let's think step by step, 1. This number has a decimal point, so it's a decimal.2. The integer part to the left of the decimal point is
text: 123456789012, which is a 12-digit integer. According to English grammar, a 12-digit number is at the hundred-billion level.3. So, the integer part from left to right can be written as one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve.4. The decimal part to the right of the decimal point is 210987654321, which according to English grammar, is written out one digit at a time.5. So the decimal part from left to right can be written as two one zero nine eight seven six five four three two one.6. The decimal point is read as 'point'.So the answer is one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve point two one zero nine eight seven six five four three two one.
The following are questions about how to convert decimals into English pronunciation. Please provide the correct answer based on the numbers in the question. Question:

heading: XXX Answer: Let's think step by step,
text: Prompt that convert decimal into Chinese in Num2Words
Zero-shot 以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：XXX 答案：
Zero-shot CoT 以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：XXX 答案：让我们一步一步思考，
Few-shot
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123.456 答案：一百二十三点四五六
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456.789012 答案：十二万三千四百五十六点七八九零一二
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456789.987654321 答案：一亿二千三百四十五万六千七百八十九点九八七 六五四三二一
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456789012.210987654321 答案：一千二百三十四亿五千六百七十八万九千 零一十二点二一零九八七六五四三二一
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：XXX 答案：
Few-shot CoT
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123.456 答案：让我们一步一步思考，1、这个数字有小数点，所以这是一个小 数；2、小数点左侧的整数部分是123，这是一个长度为3的整数，按照中文的语法，3位数字是百级别的数字；3、所以整数部分从左到右依次可以写出一百二十三； 4、小数右侧的小数部分是456，按照中文的语法，小数部分一个一个数字写出来即可；5、所以小数部分从左到右依次可以写出四五六；6、小数点读作点；所以答 案是一百二十三点四五六。
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456.789012 答案：让我们一步一步思考，1、这个数字有小数点，所以这是 一个小数；2、小数点左侧的整数部分是123456，这是一个长度为6的整数，按照中文的语法，6位数字是十万级别的数字；3、所以整数部分从左到右依次可以写出 十二万三千四百五十六；4、小数右侧的小数部分是789012，按照中文的语法，小数部分一个一个数字写出来即可；5、所以小数部分从左到右依次可以写出七八九 零一二；6、小数点读作点；所以答案是十二万三千四百五十六点七八九零一二。
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456789.987654321 答案：让我们一步一步思考，1、这个数字有小数点，所 以这是一个小数；2、小数点左侧的整数部分是123456789，这是一个长度为9的整数，按照中文的语法，9位数字是亿级别的数字；3、所以整数部分从左到右依次可 以写出一亿二千三百四十五万六千七百八十九；4、小数右侧的小数部分是987654321，按照中文的语法，小数部分一个一个数字写出来即可；5、所以小数部分从左 到右依次可以写出九八七六五四三二一；6、小数点读作点；所以答案是一亿二千三百四十五万六千七百八十九点九八七六五四三二一。
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：123456789012.210987654321 答案：让我们一步一步思考，1、这个数字有小数 点，所以这是一个小数；2、小数点左侧的整数部分是123456789012，这是一个长度为12的整数，按照中文的语法，12位数字是千亿级别的数字；3、所以整数部分 从左到右依次可以写出一千二百三十四亿五千六百七十八万九千零一十二；4、小数右侧的小数部分是210987654321，按照中文的语法，小数部分一个一个数字写出 来即可；5、所以小数部分从左到右依次可以写出二一零九八七六五四三二一；6、小数点读作点；所以答案是一千二百三十四亿五千六百七十八万九千零一十二点 二一零九八七六五四三二一。
以下是关于小数转为中文读法的题目，请根据题目的数字，给出正确的答案。题目：XXX 答案：让我们一步一步思考，
Table 6: Prompt that convert decimals to English and Chinese in Num2Words task, ‘XXX’ is a word or numerical question in the dataset.
Prompt that convert fraction into English in Num2Words
Zero-shot The following is a question about how to convert fractions into English pronunciation. Please provide the correct answer based on the numbers in the
question.Question:XXX Answer:
Zero-shot CoT The following is a question about how to convert fractions into English pronunciation. Please provide the correct answer based on the numbers in the
question.Question:XXX Answer: Let's think step by step,
Few-shot
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer based on the numbers in the question.Question:123/456 Answer:one hundred twenty three over four hundred fifty six.
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456/789012 Answer: one hundred twenty three thousand four hundred fifty six over seven hundred eighty nine thousand twelve .
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456789/987654321 Answer: one hundred twenty three million four hundred fifty six thousand seven hundred eighty nine over nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one.
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456789012/210987654321 Answer: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve over two hundred ten billion nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one .
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer based on the numbers in the question.Question:XXX Answer:
Few-shot CoT
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123/456 Answer: Let's think step by step, 1. This number has a slash, so it's a fraction.2. The numerator to the left of the slash is 123, which is a 3 -digit integer. According to English grammar, a 3-digit number is at the hundred level.3. So the numerator from left to right can be written as one hundred twenty-three.4. The denominator to the right of the slash is

heading: 456, which is also a 3-digit integer. According to English grammar, a 3-digit number is at the hundred level.5. So the denominator from left to right can be written as four hundred fifty-six.6. The slash is read as 'over'.So the answer is one hundred twenty-three over four hundred fifty-six.
text: The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456/789012 Answer: Let's think step by step, 1. This number has a slash, so it's a fraction.2. The numerator to the left of the slash is 123456, which is a 6 - digit integer. According to English grammar, a 6-digit number is at the hundred-thousand level.3. So the numerator from left to right can be written as one hundred twenty-three thousand four hundred fifty-six.4. The denominator to the right of the slash is 789012, which is also a 6-digit integer. According to English grammar, a 6-digit number is at the hundred-thousand level.5. So the denominator from left to right can be written as seven hundred eighty-nine thousand twelve.6. The slash is read as 'over'.So the answer is one hundred twenty-three thousand four hundred fifty-six over seven hundred eighty-nine thousand twelve.
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456789/987654321 Answer: Let's think step by step, 1. This number has a slash, so it's a fraction.2. The numerator to the left of the slash is 123456789, which is a 9-digit integer. According to English grammar, a 9-digit number is at the hundred-million level.3. So the numerator from left to right can be written as one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine.4. The denominator to the right of the slash is 987654321, which is also a 9-digit integer. According to English grammar, a 9-digit number is at the hundred-million level.5. So the denominator from left to right can be written as nine hundred eighty-seven million six hundred fiftyfour thousand three hundred twenty-one.6. The slash is read as 'over'.So the answer is one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine over nine hundred eighty-seven million six hundred fifty-four thousand three hundred twenty-one.
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer base d on the numbers in the question.Question:123456789012/210987654321 Answer: Let's think step by step, 1. This number has a slash, so it's a fraction.2. The numerator to the left of the slash is 123456789012, which is a 12-digit integer. According to English grammar, a 12-digit number is at the hundred-billion level.3. So the numerator from left to right can be written as one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve.4. The denominator to the right of the slash is 210987654321, which is also a 12-digit integer. According to English grammar, a 12-digit number is at the hundred-billion level.5. So the denominator from left to right can be written as two hundred ten billion nine hundred eighty-seven million six hundred fifty-four thousand three hundred twenty-one.6. The slash is read as 'over'.So the answer is one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve over two hundred ten billion nine hundred eighty-seven million six hundred fifty-four thousand three hundred twenty-one.
The following are questions about how to convert fractions into English pronunciation. Please provide the correct answer based on the numbers in the question.Question:XXX Answer: Let's think step by step,
Prompt that convert English into integer in Words2Num
Zero-shot The following is a question about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer:
Zero-shot CoT The following is a question about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer: Let's think step by step,
Few-shot
The following are questions about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question: One hundred twenty-three Answer: 123
The following are questions about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question: One hundred twenty-three thousand four hundred fifty-six Answer: 123456
The following are questions about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question: One hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine Answer: 123456789
The following are questions about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question: One hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve Answer: 123456789012
The following are questions about how to convert English pronunciation into integers. Please provide the correct answer based on the numbers in the question. Question:

heading: XXX Answer:
text: Few-shot CoT
The following are questions about how to convert English pronunciation into integers. Please give the correct answers based on the English words in the questions. Question: One hundred twenty-three Answer: Let's think step by step, 1. Write it down in order from left to right, one hundred is written as 100, twenty is written as 20, three is written as 3; 2. Add all the numbers above, 100 + 20 + 3 = 123; So, the answer is 123.
The following are questions about how to convert English pronunciation into integers. Please give the correct answers based on the English words in the questions. Question: One hundred twenty-three thousand four hundred fifty-six Answer: Let's think step by step, 1. Write it down in order from left to right, one hundred twenty-three thousand is written as

heading: 123000, four hundred fifty-six is written as 456; 2. Add all the numbers above, 123000 + 456 = 123456; So, the answer is 123456.
text: The following are questions about how to convert English pronunciation into integers. Please give the correct answers based on the English words in the questions. Question: One hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine Answer: Let's think step by step, 1. Write it down in order from left to right, one hundred twenty-three million is written as 123000000, four hundred fifty-six thousand is written as 456000, seven hundred eighty-nine is written as 789; 2. Add all the numbers above,

heading: 123000000 + 456000 + 789 = 123456789; So, the answer is 123456789.
text: The following are questions about how to convert English pronunciation into integers. Please give the correct answers based on the English words in the questions. Question: One hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand and twelve Answer: Let's think step by step, 1. Write it down in order from left to right, one hundred twenty-three billion is written as 123000000000, four hundred fifty-six million is written as 456000000, seven hundred eighty-nine thousand is written as 789000, twelve is written as 12; 2. Add all the numbers above, 123000000000 + 456000000 + 789000 + 12 = 123456789012; So, the answer is 123456789012.
The following are questions about how to convert English pronunciation into integers. Please give the correct answers based on the English words in the questions. Question: XXX Answer: Let's think step by step,
Prompt that convert English into decimal in Words2Num
Zero-shot The following is a question about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer:
Zero-shot CoT The following is a question about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer: Let's think step by step,
Few-shot
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three point four five six Answer:123.456
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three thousand four hundred fifty six point seven eight nine zero one two Answer:123456.789012
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred and twenty-three million four hundred and fifty-six thousand seven hundred and eighty-nine point nine eight seven six five four three two one Answer:123456789.987654321
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve point two one zero nine eight seven six five four three two one Answer:123456789012.210987654321
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: XXX Answer:
Few-shot CoT
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three point four five six Answer: Let's think step by step, 1. The presence of the character 'point' in the problem indicates that this is a decimal number;2. To the left of 'point', 'one hundred and twenty-three' is the integer part, written as 123;3. To the right of 'point', 'four five six' is the decimal part, written as 456;4. The 'point' is written as '.';So the answer is 123.456.
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three thousand four hundred fifty six point seven eight nine zero one two Answer: Let's think step by step, 1. The presence of the character 'point' in the problem indicates that this is a decimal number;2. To the left of 'point', 'one hundred twenty-three thousand four hundred fifty-six' is the integer part, written as 123456;3. To the right of 'point', 'seven eight nine zero one two' is the decimal part, written as 789012;4. The 'point' is written as '.';So the answer is 123456.789012.
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred and twenty-three million four hundred and fifty-six thousand seven hundred and eighty-nine point nine eight seven six five four three two one Answer: Let's think step by step, 1. The presence of the character 'point' in the problem indicates that this is a decimal number;2. To the left of 'point', 'one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine' is the integer part, written as 123456789;3. To the right of 'point', 'nine eight seven six five four three two one' is the decimal part, written as

heading: 987654321;4. The 'point' is written as '.';So the answer is 123456789.987654321.
text: The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve point two one zero nine eight seven six five four three two one Answer: Let's think step by step, 1. The presence of the character 'point' in the problem indicates that this is a decimal number;2. To the left of 'point', 'one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve' is the integer part, written as 123456789012;3. To the right of 'point', 'two one zero nine eight seven six five four three two one' is the decimal part, written as 210987654321;4. The 'point' is written as '.';So the answer is 123456789012.210987654321.
The following are questions about how to convert English pronunciation into decimals. Please provide the correct answer based on the numbers in the question. Question: XXX Answer: Let's think step by step,
Prompt that convert Chinese into decimal in Words2Num
Zero-shot 以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：XXX 答案：
Zero-shot CoT 以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一百二十三点四五六 答案：123.456
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：十二万三千四百五十六点七八九零一二 答案：123456.789012
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一亿二千三百四十五万六千七百八十九点九八七六五四三二一 答案： 123456789.987654321
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一千二百三十四亿五千六百七十八万九千零一十二点二一零九八七六五四三二一 答案：123456789012.210987654321
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：XXX 答案：
Few-shot CoT
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一百二十三点四五六 答案：让我们一步一步思考，1、题目里出现了'点'这个汉字， 说明这是一个小数；2、'点'字左边'一百二十三'的是整数部分，写作123；3、'点'字右边'四五六'的是小数部分，写作456；4、'点'字写作. ；所以答案是 123.456。
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：十二万三千四百五十六点七八九零一二 答案：让我们一步一步思考，1、题目里出 现了'点'这个汉字，说明这是一个小数；2、'点'字左边'十二万三千四百五十六'的是整数部分，写作123456；3、'点'字右边'七八九零一二'的是小数部分，写作 789012；4、'点'字写作. ；所以答案是123456.789012。
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一亿二千三百四十五万六千七百八十九点九八七六五四三二一 答案：让我们一步 一步思考，1、题目里出现了'点'这个汉字，说明这是一个小数；2、'点'字左边'一亿二千三百四十五万六千七百八十九'的是整数部分，写作123456789；3、'点' 字右边'九八七六五四三二一'的是小数部分，写作987654321；4、'点'字写作. ；所以答案是123456789.987654321。
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：一千二百三十四亿五千六百七十八万九千零一十二点二一零九八七六五四三二一 答案：让我们一步一步思考，1、题目里出现了'点'这个汉字，说明这是一个小数；2、'点'字左边'一千二百三十四亿五千六百七十八万九千零一十二'的是整数部 分，写作123456789012；3、'点'字右边'二一零九八七六五四三二一'的是小数部分，写作210987654321；4、'点'字写作. ；所以答案是 123456789012.210987654321。
以下是关于中文转为小数的题目，请根据题目的中文，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Table 9: Prompt that convert English and Chinese to decimal in Words2Num task, ‘XXX’ is a word or numerical question in the dataset.
Prompt that convert English into fraction in Words2Num
Zero-shot The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer:
Zero-shot CoT The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question:
XXX Answer: Let's think step by step,
Few-shot
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three over four hundred fifty six Answer:123/456
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three thousand four hundred fifty six over seven hundred eighty nine thousand twelve Answer:123456/789012
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three million four hundred fifty six thousand seven hundred eighty nine over nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one Answer:123456789/987654321
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve over two hundred ten billion nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one Answer:123456789012/210987654321
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question:

heading: XXX Answer:
text: Few-shot CoT
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three over four hundred fifty six Answer: Let's think step by step, 1. The appearance of the term 'over' in the problem indicates that this is a fraction;2. To the left of 'over', 'four hundred fifty-six' is the denominator, written as 456;3. To the right of 'over', 'one hundred twenty-three' is the numerator, written as 123;4. 'over' is written as '/';5. When written as a fraction, the numerator is written first, followed by '/', and then the denominator;So the answer is 123/456.
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three thousand four hundred fifty six over seven hundred eighty nine thousand twelve Answer: Let's think step by step, 1. The appearance of the term 'over' in the problem indicates that this is a fraction;2. To the left of 'over', 'seven hundred eighty-nine thousand twelve' is the denominator, written as 789012;3. To the right of 'over', 'one hundred twenty-three thousand four hundred fifty-six' is the numerator, written as 123456;4. 'over' is written as '/';5. When written as a fraction, the numerator is written first, followed by '/', and then the denominator;So the answer is 123456/789012.
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three million four hundred fifty six thousand seven hundred eighty nine over nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one Answer: Let's think step by step, 1. The appearance of the term 'over' in the problem indicates that this is a fraction;2. To the left of 'over', 'nine hundred eighty-seven million six hundred fifty four thousand three hundred twenty-one' is the denominator, written as 987654321;3. To the right of 'over', 'one hundred twenty-three million four hundred fifty-six thousand seven hundred eighty-nine' is the numerator, written as 123456789;4. 'over' is written as '/';5. When written as a fraction, the numerator is written first, followed by '/', and then the denominator;So the answer is 123456789/987654321.
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question: one hundred twenty three billion four hundred fifty six million seven hundred eighty nine thousand twelve over two hundred ten billion nine hundred eighty seven million six hundred fifty four thousand three hundred twenty one Answer: Let's think step by step, 1. The appearance of the term 'over' in the problem indicates that this is a fraction;2. To the left of 'over', 'two hundred ten billion nine hundred eighty-seven million six hundred fifty-four thousand three hundred twenty-one' is the denominator, written as 210987654321;3. To the right of 'over', 'one hundred twenty-three billion four hundred fifty-six million seven hundred eighty-nine thousand twelve' is the numerator, written as 123456789012;4. 'over' is written as '/';5. When written as a fraction, the numerator is written first, followed by '/', and then the denominator;So the answer is 123456789012/210987654321.
The following is a question about how to convert English pronunciation into fractions. Please provide the correct answer based on the numbers in the question. Question:

heading: XXX Answer: Let's think step by step,
text: Prompt of English unit conversion in Unit of Measurement
Zero-shot The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question: XXX answer:
Zero-shot CoT The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：XXX answer: Let's think step by step,
Few-shot
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：5900 meters= ?centimeters answer:

heading: 590000 centimeters.
text: The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：479 minutes - 630 seconds= ?seconds answer: 28110 seconds.
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：7 tons 54 kilogram + 68 kilogram= ?tons ?kilograms answer: 7 tons 122 kilograms.
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：XXX answer:
Few-shot CoT
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：5900 meters= ?centimeter answer: Let's think step by step, The unit on the right side of the question mark is centimeters. Since 1 meter=100 centimeters, 5900 meters=5900 * 100 centimeters, so the answer is

heading: 590000 centimeters.
text: The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：479 minutes - 630 seconds= ?seconds answer: Let's think step by step, The unit on the right side of the question mark is seconds. Since 1 minute equals 60 seconds, 479 minutes=479 * 60 seconds=28740 seconds. Because 28740 seconds - 630 seconds=28110 seconds, the answer is 28110 seconds.
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：7 tons 54 kilogram + 68 kilogram= ?tons ?kilograms answer: Let's think step by step, The units on the right side of the question mark are tons and kilograms. Since 1 ton=1000 kilograms, 7 tons and 54 kilograms=7 * 1000+54=7054 kilograms. Because 7054 kg+68 kg=7122 kg, and 1 kg=1/1000 tons, 7122 kg=7 tons 122 kg.
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：XXX answer: Let's think step by step,
Few-shot CoT with knowledge
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：5900 meters= ?centimeter answer: Let's think step by step, Firstly, it is necessary to understand the following common knowledge about unit conversion: 1 ton=1000 kilograms; 1 kilogram=1000 grams; 1 gram=1000 milligrams; 1 week=7 days; 1 day=24 hours; 1 hour=60 minutes; 1 minute=60 seconds; 1 second=1000 milliseconds; 1 kilometer=1000 meters; 1 meter=10 decimeters;

heading: 1 decimeter=10 centimeters; 1 centimeter=10 millimeters; 1 yuan=10 jiao; 1 jiao=10 cents. The unit on the right side of the question mark is centimeters. Since 1 meter=100 centimeters, 5900 meters=5900 * 100 centimeters, so the answer is 590000 centimeters.
text: The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：479 minutes - 630 seconds= ?seconds answer: Let's think step by step, Firstly, it is necessary to understand the following common knowledge about unit conversion: 1 ton=1000 kilograms; 1 kilogram=1000 grams; 1 gram=1000 milligrams; 1 week=7 days; 1 day=24 hours; 1 hour=60 minutes; 1 minute=60 seconds; 1 second=1000 milliseconds; 1 kilometer=1000 meters;

heading: 1 meter=10 decimeters; 1 decimeter=10 centimeters; 1 centimeter=10 millimeters; 1 yuan=10 jiao; 1 jiao=10 cents. The unit on the right side of the question mark is seconds. Since

heading: 1 minute equals 60 seconds, 479 minutes=479 * 60 seconds=28740 seconds. Because 28740 seconds - 630 seconds=28110 seconds, the answer is 28110 seconds.
text: The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：7 tons 54 kilogram + 68 kilogram= ?tons ?kilograms answer: Let's think step by step, Firstly, it is necessary to understand the following common knowledge about unit conversion: 1 ton=1000 kilograms;

heading: 1 kilogram=1000 grams; 1 gram=1000 milligrams; 1 week=7 days; 1 day=24 hours; 1 hour=60 minutes; 1 minute=60 seconds; 1 second=1000 milliseconds; 1 kilometer=1000 meters; 1 meter=10 decimeters; 1 decimeter=10 centimeters; 1 centimeter=10 millimeters; 1 yuan=10 jiao; 1 jiao=10 cents. The units on the right side of the question mark are tons
text: and kilograms. Since 1 ton=1000 kilograms, 7 tons and 54 kilograms=7 * 1000+54=7054 kilograms. Because 7054 kg+68 kg=7122 kg, and 1 kg=1/1000 tons, 7122 kg=7 tons 122 kg.
The following is a question about unit conversion. Please provide the correct answer at the question mark according to the question. question：XXX answer: Let's think step by step, Firstly, it is necessary to understand the following common knowledge about unit conversion: 1 ton=1000 kilograms; 1 kilogram=1000 grams; 1 gram=1000 milligrams; 1 week=7 days; 1 day=24 hours; 1 hour=60 minutes; 1 minute=60 seconds; 1 second=1000 milliseconds; 1 kilometer=1000 meters; 1 meter=10 decimeters; 1 decimeter=10 centimeters; 1 centimeter=10 millimeters; 1 yuan=10 jiao; 1 jiao=10 cents.
Prompt of Chinese unit conversion in Unit of Measurement
Zero-shot 以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：XXX 答案：
Zero-shot CoT 以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：5900米=？厘米 答案：590000厘米
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：479分钟 - 630秒钟 = ?秒钟 答案：28110秒钟
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：7吨54千克 + 68千克 = ?吨?千克 答案：7吨122千克
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：XXX 答案：
Few-shot CoT
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：5900米=？厘米 答案：让我们一步一步思考，问号右侧的单位是厘米，由于1米=100厘 米，所以5900米=5900*100厘米，所以答案是590000厘米。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：479分钟 - 630秒钟 = ?秒钟 答案：让我们一步一步思考，问号右侧的单位是秒钟， 由于1分钟=60秒钟，因此479分钟=479*60秒钟=28740秒钟。又因为28740秒钟-630秒钟=28110秒钟， 所以答案是28110秒钟。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：7吨54千克 + 68千克 = ?吨?千克 答案：让我们一步一步思考，问号右侧的单位是吨 和千克，由于1吨=1000千克，因此7吨54千克=7*1000+54=7054千克。因为7054千克+68千克=7122千克，且1千克=1/1000吨，所以7122千克=7吨122千克。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot CoT with knowledge
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：5900米=？厘米 答案：让我们一步一步思考，首先需要了解如下的单位转化常识：1吨 =1000千克；1千克=1000克；1克=1000毫克；1周=7天；1天=24小时；1小时=60分钟；1分钟=60秒钟；1秒钟=1000毫秒；1千米=1000米；1米=10分米；1分米=10厘米； 1厘米=10毫米；1元=10角；1角=10分钱。问号右侧的单位是厘米，由于1米=100厘米，所以5900米=5900*100厘米，所以答案是590000厘米。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：479分钟 - 630秒钟 = ?秒钟 答案：让我们一步一步思考，首先需要了解如下的单位 转化常识：1吨=1000千克；1千克=1000克；1克=1000毫克；1周=7天；1天=24小时；1小时=60分钟；1分钟=60秒钟；1秒钟=1000毫秒；1千米=1000米；1米=10分米； 1分米=10厘米；1厘米=10毫米；1元=10角；1角=10分钱。问号右侧的单位是秒钟，由于1分钟=60秒钟，因此479分钟=479*60秒钟=28740秒钟。又因为28740秒钟-630 秒钟=28110秒钟， 所以答案是28110秒钟。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：7吨54千克 + 68千克 = ?吨?千克 答案：让我们一步一步思考，首先需要了解如下的 单位转化常识：1吨=1000千克；1千克=1000克；1克=1000毫克；1周=7天；1天=24小时；1小时=60分钟；1分钟=60秒钟；1秒钟=1000毫秒；1千米=1000米；1米=10分 米；1分米=10厘米；1厘米=10毫米；1元=10角；1角=10分钱。问号右侧的单位是吨和千克，由于1吨=1000千克，因此7吨54千克=7*1000+54=7054千克。因为7054千 克+68千克=7122千克，且1千克=1/1000吨，所以7122千克=7吨122千克。
以下是关于单位转化的题目，请根据题目，给出问号处的正确答案。 题目：{question} 答案：让我们一步一步思考，首先需要了解如下的单位转化常识：1吨 =1000千克；1千克=1000克；1克=1000毫克；1周=7天；1天=24小时；1小时=60分钟；1分钟=60秒钟；1秒钟=1000毫秒；1千米=1000米；1米=10分米；1分米=10厘米； 1厘米=10毫米；1元=10角；1角=10分钱。
Table 11: Prompt of English and Chinese unit conversion in Units of Measurement task, ‘XXX’ is a word or numerical question in the dataset.
Prompt of calculate English Math Problems of MWP
Zero-shot The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions.
Question：XXX Answer：
Zero-shot CoT
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question：XXX Answer：Let's think step by step,
Few-shot
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question： Mike picked 7 apples , Nancy picked 3 apples , and Keith picked 6 apples and 4 pears , at the farm . How many apples were picked in total ? Answer：16.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question： Tammy drove 55 miles in one hour. At that rate, how far can she drive in 36 hours? Answer：1980.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question：A trivia team had 15 members total, but during a game 6 members didn't show up. If each member that did show up scored 3 points, how many points were scored total? Answer：27.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question：XXX Answer：
Few-shot CoT
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question： Mike picked 7 apples , Nancy picked 3 apples , and Keith picked 6 apples and 4 pears , at the farm . How many apples were picked in total ? Answer：Let's think step by step, Due to Mike having 7 apples, Nancy having 3 apples, and Keith having 6 apples, there are a total of 7+3+6=16 apples picked.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question： Tammy drove 55 miles in one hour. At that rate, how far can she drive in 36 hours? Answer：Let's think step by step, Tammy can drive 55 miles per hour, with a total distance of 36 hours, totaling 55 * 36=1980 miles. The answer is that it can drive 1980 miles.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question：A trivia team had 15 members total, but during a game 6 members didn't show up. If each member that did show up scored 3 points, how many points were scored total? Answer：Let's think step by step, There are a total of 15 members in the team, and 6 members did not appear, indicating the presence of 9 members from 15-6. Each member who appears has 3 points, so a total of 9 members scored 9 * (15-9)=27 points, and the answer is 27 points.
The following are questions containing unit and numerical calculations. Please provide the correct answers based on the questions. Question：XXX Answer：Let's think step by step,
Prompt of calculate Chinese Math Problems of MWP
Zero-shot 以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：
Zero-shot CoT 以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：在农场，迈克摘了7个苹果，南希摘了3个，基思摘了6 个苹果和4个梨。一共摘了多少个苹果？ 答案：16。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：塔米一小时开了55英里。照这样下去，她36小时能开多 远？ 答案：1980。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：一个琐事小组总共有15名成员，但在一场比赛中有6名 成员没有出现。如果每个出现的成员都得了3分，总共得了多少分？ 答案：27。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：
Few-shot CoT
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：在农场，迈克摘了7个苹果，南希摘了3个，基思摘了6 个苹果和4个梨。一共摘了多少个苹果？ 答案：让我们一步一步思考，由于迈克有7个苹果，南希有3个苹果，基思有6个苹果，所 以一共有7+3+6=16，答案是一共摘了16个苹果。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：塔米一小时开了55英里。照这样下去，她36小时能开多 远？ 答案：让我们一步一步思考，塔米一小时能开55英里，开了36小时的总距离，一共有55*36=1980英里，答案是能开1980英里。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：一个琐事小组总共有15名成员，但在一场比赛中有6名 成员没有出现。如果每个出现的成员都得了3分，总共得了多少分？ 答案：让我们一步一步思考，小组一共有15名成员，6名成员 没有出现，说明出现了15-6=9名成员。每名出现的成员有3分，所以9名成员一共得了9*(15-9)=27分，答案是一共得了27分。
以下是含有单位和数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Table 12: Prompt of calculate English and Chinese math problems of MWPs, ‘XXX’ is a question in the dataset.
Prompt of calculate Chinese Math Problems of SUANJING
Zero-shot 以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：
Zero-shot CoT 以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有七个人平分八又三分之一钱。问：每个人各得到多少钱？ 答案： 人得一钱、二十一分钱之四。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有一个直角梯形田，其中一面宽三十步，另外一面宽四十二步，高六十 四步。问这个田的面积是多少？ 答案：九亩一百四十四步。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有九块黄金和十一块白银，它们的质量相同。如果将其中一块黄金和白 银进行交换，那么黄金的重量就会轻十三两。问：每块黄金和每块白银的重量各是多少？ 答案：金重二斤三两一十八铢，银重一斤十三两六铢。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：
Few-shot CoT
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有七个人平分八又三分之一钱。问：每个人各得到多少钱？ 答案： 让我们一步一步思考，我们首先要明确“八又三分之一”这个数字的确切意思。在这里，“八又三分之一”意味着 8 加上 1/3，等于25/3。这个问题是关于平均分 配的，所以我们需要将总金额除以人数。这里的总金额是25/3，平均每个人可以分到25/3除以7，这个结果用小数表示约等于1.19钱，用分数表示是25/21钱，或表 示为一又二十一分之四钱，或表示为一钱二十一分钱之四。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有一个直角梯形田，其中一面宽三十步，另外一面宽四十二步，高六十 四步。问这个田的面积是多少？ 答案：让我们一步一步思考，要计算直角梯形的面积，我们可以使用公式：梯形面积=（上底+下底）* 高 / 2。在这个问题中， 梯形的上底和下底是两个不同的边。由于梯形是直角梯形，我们可以直接使用这些边作为上底和下底。根据题目，这两边的长度分别是 30 步和 42 步，高是 64 步。所以，梯形的面积可以计算如下：梯形面积=（30+42）* 64 / 2 = 2304步，由于1亩=240步，所以2304步又等于9亩144步，即九亩一百四十四步。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有九块黄金和十一块白银，它们的质量相同。如果将其中一块黄金和白 银进行交换，那么黄金的重量就会轻十三两。问：每块黄金和每块白银的重量各是多少？ 答案：让我们一步一步思考，这是一个典型的数学问题，我们可以用方 程来解决。设每块黄金的重量为X两，每块白银的重量为Y两。根据题意，我们有9块黄金和11块白银，所以黄金部分的重量为9X，白银部分的重量为11Y。首先9块黄 金和11块白银的质量相同，所以9X = 11Y。当我们将一块黄金和一块白银进行交换后，黄金部分的重量变为9X - X + Y = 8X + Y，白银部分的重量变为11Y - Y + X = 10Y + X。根据题意，新的黄金部分重量比新的白银重量轻十三两，即10Y + X - (8X + Y) = 13。现在我们可以通过9X = 11Y和10Y + X - (8X + Y) = 13这两 个方程，来解出每块黄金和每块白银的重量，让我们计算一下。首先，让我们处理第二个方程10Y + X - (8X + Y) = 13。我们可以简化它，然后使用第一个方程来 找到解。这个简化过程如下：先化简为10Y + X - 8X - Y = 13，再化简为9Y - 7X =13。接下来，我们可以利用第一个方程9X = 11Y来解9Y - 7X =13。求解之后， 我们可以得到以下结果：X（黄金的重量）是143/4两，即35.75两。Y（白银的重量）是117/4两，即29.25两。又因为1斤=16两，一两=24铢，所以金重35.75两等于 二斤三两一十八铢，银重29.25两等于一斤十三两六铢。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，
Few-shot CoT with knowledge
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有七个人平分八又三分之一钱。问：每个人各得到多少钱？ 答案： 让我们一步一步思考，这里我们要先了解一些知识，1秒=10忽；1毫=10秒；1厘=10毫；1分=10厘；一寸=10分；1尺=10存；1丈=10尺；1引=10丈；1端=50尺；1疋=40 尺；1匹=1疋；1步=6尺；1顷=100亩；1亩=240步；1亩=240积步；1里=300步；1里=375亩；1两=24铢；1斤=16两；1钧=30斤；1石=4钧；1圭=6粟；1抄=10圭；1撮=10 抄；1勺=10撮；1合=10勺；1升=10合；1斗=10升；1斛=10斗；1秉=16斛；50栗米=30粝米；50栗米=27粺米；50栗米=24凿米；50栗米=21御米；50栗米=13.5小䵂；50 栗米=54大䵂；50栗米=75粝饭；50栗米=54粺饭；50栗米=48凿饭；50栗米=42御饭；50栗米=45菽；50栗米=45答；50栗米=45麻；50栗米=45麦；50栗米=60稻；50栗 米=63豉；50栗米=90豉；50栗米=115熟菽；50栗米=175蘖；1岁=354日；4穿地=5壤；4穿地=5坚；4穿地=5墟。我们首先要明确“八又三分之一”这个数字的确切意 思。在这里，“八又三分之一”意味着 8 加上 1/3，等于25/3。这个问题是关于平均分配的，所以我们需要将总金额除以人数。这里的总金额是25/3，平均每个人 可以分到25/3除以7，这个结果用小数表示约等于1.19钱，用分数表示是25/21钱，或表示为一又二十一分之四钱，或表示为一钱二十一分钱之四。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有一个直角梯形田，其中一面宽三十步，另外一面宽四十二步，高六十 四步。问这个田的面积是多少？ 答案：让我们一步一步思考，这里我们要先了解一些知识，1秒=10忽；1毫=10秒；1厘=10毫；1分=10厘；一寸=10分；1尺=10存； 1丈=10尺；1引=10丈；1端=50尺；1疋=40尺；1匹=1疋；1步=6尺；1顷=100亩；1亩=240步；1亩=240积步；1里=300步；1里=375亩；1两=24铢；1斤=16两；1钧=30斤； 1石=4钧；1圭=6粟；1抄=10圭；1撮=10抄；1勺=10撮；1合=10勺；1升=10合；1斗=10升；1斛=10斗；1秉=16斛；50栗米=30粝米；50栗米=27粺米；50栗米=24凿米； 50栗米=21御米；50栗米=13.5小䵂；50栗米=54大䵂；50栗米=75粝饭；50栗米=54粺饭；50栗米=48凿饭；50栗米=42御饭；50栗米=45菽；50栗米=45答；50栗米=45 麻；50栗米=45麦；50栗米=60稻；50栗米=63豉；50栗米=90豉；50栗米=115熟菽；50栗米=175蘖；1岁=354日；4穿地=5壤；4穿地=5坚；4穿地=5墟。要计算直角梯 形的面积，我们可以使用公式：梯形面积=（上底+下底）* 高 / 2。在这个问题中，梯形的上底和下底是两个不同的边。由于梯形是直角梯形，我们可以直接使用 这些边作为上底和下底。根据题目，这两边的长度分别是 30 步和 42 步，高是 64 步。所以，梯形的面积可以计算如下：梯形面积=（30+42）* 64 / 2 = 2304步， 由于1亩=240步，所以2304步又等于9亩144步，即九亩一百四十四步。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：现在有九块黄金和十一块白银，它们的质量相同。如果将其中一块黄金和白 银进行交换，那么黄金的重量就会轻十三两。问：每块黄金和每块白银的重量各是多少？ 答案：让我们一步一步思考，这里我们要先了解一些知识，1秒=10忽； 1毫=10秒；1厘=10毫；1分=10厘；一寸=10分；1尺=10存；1丈=10尺；1引=10丈；1端=50尺；1疋=40尺；1匹=1疋；1步=6尺；1顷=100亩；1亩=240步；1亩=240积步； 1里=300步；1里=375亩；1两=24铢；1斤=16两；1钧=30斤；1石=4钧；1圭=6粟；1抄=10圭；1撮=10抄；1勺=10撮；1合=10勺；1升=10合；1斗=10升；1斛=10斗；1秉 =16斛；50栗米=30粝米；50栗米=27粺米；50栗米=24凿米；50栗米=21御米；50栗米=13.5小䵂；50栗米=54大䵂；50栗米=75粝饭；50栗米=54粺饭；50栗米=48凿饭； 50栗米=42御饭；50栗米=45菽；50栗米=45答；50栗米=45麻；50栗米=45麦；50栗米=60稻；50栗米=63豉；50栗米=90豉；50栗米=115熟菽；50栗米=175蘖；1岁=354 日；4穿地=5壤；4穿地=5坚；4穿地=5墟。这是一个典型的数学问题，我们可以用方程来解决。设每块黄金的重量为X两，每块白银的重量为Y两。根据题意，我们有 9块黄金和11块白银，所以黄金部分的重量为9X，白银部分的重量为11Y。首先9块黄金和11块白银的质量相同，所以9X = 11Y。当我们将一块黄金和一块白银进行交 换后，黄金部分的重量变为9X - X + Y = 8X + Y，白银部分的重量变为11Y - Y + X = 10Y + X。根据题意，新的黄金部分重量比新的白银重量轻十三两，即10Y + X - (8X + Y) = 13。现在我们可以通过9X = 11Y和10Y + X - (8X + Y) = 13这两个方程，来解出每块黄金和每块白银的重量，让我们计算一下。首先，让我们处 理第二个方程10Y + X - (8X + Y) = 13。我们可以简化它，然后使用第一个方程来找到解。这个简化过程如下：先化简为10Y + X - 8X - Y = 13，再化简为9Y - 7X =13。接下来，我们可以利用第一个方程9X = 11Y来解9Y - 7X =13。求解之后，我们可以得到以下结果：X（黄金的重量）是143/4两，即35.75两。Y（白银的重 量）是117/4两，即29.25两。又因为1斤=16两，1两=24铢，所以金重35.75两等于二斤三两一十八铢，银重29.25两等于一斤十三两六铢。
以下是含有单位和关于汉字数字计算的题目，请根据题目，给出正确的答案。 题目：XXX 答案：让我们一步一步思考，这里我们要先了解一些知识，1秒=10忽； 1毫=10秒；1厘=10毫；1分=10厘；一寸=10分；1尺=10存；1丈=10尺；1引=10丈；1端=50尺；1疋=40尺；1匹=1疋；1步=6尺；1顷=100亩；1亩=240步；1亩=240积步； 1里=300步；1里=375亩；1两=24铢；1斤=16两；1钧=30斤；1石=4钧；1圭=6粟；1抄=10圭；1撮=10抄；1勺=10撮；1合=10勺；1升=10合；1斗=10升；1斛=10斗；1秉 =16斛；50栗米=30粝米；50栗米=27粺米；50栗米=24凿米；50栗米=21御米；50栗米=13.5小䵂；50栗米=54大䵂；50栗米=75粝饭；50栗米=54粺饭；50栗米=48凿饭； 50栗米=42御饭；50栗米=45菽；50栗米=45答；50栗米=45麻；50栗米=45麦；50栗米=60稻；50栗米=63豉；50栗米=90豉；50栗米=115熟菽；50栗米=175蘖；1岁=354 日；4穿地=5壤；4穿地=5坚；4穿地=5墟。
Table 13: Prompt of calculate the modern version of mathematical problems of SUANJING, ‘XXX’ is a question in the dataset.

heading: Future Work
text: To enhance the accuracy of LLMs in such tasks, future improvements could focus on refining LLMs’ ability to recognize the length and magnitude of numbers. Our experiments also demonstrated that CoT did not work in the numeral conversion experiments. LLMs achieved significantly higher accuracy rates on the easy dataset, which was of comparable scale to the medium dataset but required shorter answer lengths. This discrepancy highlights two main challenges that LLMs face in numerical reasoning. First, the linguistic nature of input text makes it difficult for LLMs to understand numerical data. Second, the flexibility and complexity of the answers increase the likelihood of errors in longer outputs. Given that CoT primarily enhances performance on complex inference tasks rather than simple ones, its application to simpler tasks such as Num2Words and Words2Num increases the length of the generated text, thereby diminishing LLMs accuracy. In the units of measurement experiment, the majority of errors primarily stem from LLMs’ failure to correctly recognize the conversion magnitude relationship when multiple units are involved. As
depicted in the figure 4b, there exists a tenfold progressive relationship between decimeters and centimeters, yet LLMs overlook the magnitude relationship inherent in textual units. Introducing CoT significantly mitigates the occurrence of such errors but still requires further refinement. Additionally, even when LLMs have correctly grasped the magnitude relationship inherent in textual units, errors may still occur during the calculation process. To enhance the accuracy of LLMs in such tasks, efforts could be directed towards improving LLMs’ recognition of textual units and the magnitude relationships between units. In the SUANJING experiment, LLMs face more comprehensive problem-solving tasks. As depicted in the figure 5, LLMs encounter errors in handling units in SUANJING problems, as some ancient units are extremely rare in contemporary society, making it difficult for LLMs to correctly understand SUANJING problems. This long tail problem can be addressed by introducing external knowledge in the prompt, thereby enabling LLMs to have a chance of correctly handling SUANJING problems. However, LLMs frequently make errors in recognizing numbers and performing numerical calculations, especially in the recognition and computation of more challenging fractions and decimals. 要计算这块田的面积，我们可以使用矩形的面积公式： 面积 = 宽度 × 长度。根据题目，田的宽度是五分之四 步，长度是九分之五步。
所以，田的面积可以计算如下：面积 = 五分之四步 × 九分之五步。首先我们需要将五分之四和九分之五化为 小数形式。五分之四 = 5/4 = 1. 25，九分之五 = 9/5 = 1. 8。
然后我们可以计算面积：面积 = 1. 25步 × 1. 8步 = 2. 25步。所以，这块田的面积是2. 25步。
还有一块田，它的宽是五分之四步，长是九分之五步，问 这田的面积是多少？
要计算田的面积，我们可以使用公式：面积=长 × 宽。 根据题目，田的宽是十二步，长是十四步。
所以，面积=10 × 12 = 140步，由于1亩=240步，所以 140步又等于0. 583亩，即0. 583亩。
（需要注意到，1亩=240步）
又有一块田，它的宽是十二步，长是十四步。问：这田的 面积是多少？