NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoning
Authors: Eli Schwartz, Leshem Choshen, Joseph Shtok, Sivan Doveh, Leonid Karlinsky, Assaf Arbelle


Reviewer paper summaries: This paper proposes prepending the number of digits when to numbers during training in order to help LMs in math reasoning tasks.
Summary of strengths: The results of this technique appear to help LMs significantly and consistently on numerical reasoning tasks. The technique is general and it appears that it can be applied as a fine-tuning step without degrading LM performance.
Summary of weaknesses: This paper lacks an important ablations: what if the "digit prefix" were replaced with the same number of filler tokens? Perhaps the additional computation afforded by the prefix is sufficient to explain the gains.
Comments, suggestions and typos: L033: extra parens
Overall assessment scores: 4