Math Word Problem Solving
71 papers with code • 12 benchmarks • 20 datasets
A math word problem is a mathematical exercise (such as in a textbook, worksheet, or exam) where significant background information on the problem is presented in ordinary language rather than in mathematical notation. As most word problems involve a narrative of some sort, they are sometimes referred to as story problems and may vary in the amount of technical language used.
Benchmarks
These leaderboards are used to track progress in Math Word Problem Solving
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Math Word Problem Solving models and implementations
MATH
SVAMP
ASDiv
MathQA
MathVista
IconQA
Geometry3K
Most implemented papers
LLaMA: Open and Efficient Foundation Language Models
facebookresearch/llama
•
•
arXiv 2023
We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters.
Llama 2: Open Foundation and Fine-Tuned Chat Models
In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters.
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
microsoft/DeBERTa
•
•
ICLR 2021
Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks.
Analysing Mathematical Reasoning Abilities of Neural Models
The structured nature of the mathematics domain, covering arithmetic, algebra, probability and calculus, enables the construction of training and test splits designed to clearly illuminate the capabilities and failure-modes of different architectures, as well as evaluate their ability to compose and relate knowledge and learned processes.
Mistral 7B
We introduce Mistral 7B v0. 1, a 7-billion-parameter language model engineered for superior performance and efficiency.
Measuring Mathematical Problem Solving With the MATH Dataset
hendrycks/math
•
•
To facilitate future research and increase accuracy on MATH, we also contribute a large auxiliary pretraining dataset which helps teach models the fundamentals of mathematics.
Mixtral of Experts
hit-scir/chinese-mixtral-8x7b
•
•
In particular, Mixtral vastly outperforms Llama 2 70B on mathematics, code generation, and multilingual benchmarks.
Are NLP Models really able to Solve Simple Math Word Problems?
arkilpatel/SVAMP
•
•
NAACL 2021
Since existing solvers achieve high performance on the benchmark datasets for elementary level MWPs containing one-unknown arithmetic word problems, such problems are often considered "solved" with the bulk of research attention moving to more complex MWPs.
Large Language Models are Zero-Shot Reasoners
kojima-takeshi188/zero_shot_cot
•
•
Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars.
PAL: Program-aided Language Models
srush/minichain
•
•
Much of this success can be attributed to prompting methods such as "chain-of-thought'', which employ LLMs for both understanding the problem description by decomposing it into steps, as well as solving each step of the problem.
