Reasoning

151 benchmarks • 75 tasks • 224 datasets • 5943 papers with code

Classification

Classification

3699 papers with code

Text Classification

1276 papers with code

Graph Classification

466 papers with code

Medical Image Classification

174 papers with code

Audio Classification

171 papers with code

See all 24 tasks

Question Answering

Question Answering

3839 papers with code

Open-Domain Question Answering

230 papers with code

Open-Ended Question Answering

223 papers with code

Knowledge Base Question Answering

68 papers with code

Conversational Question Answering

62 papers with code

See all 20 tasks

Decision Making

Decision Making

2771 papers with code

Imitation Learning

652 papers with code

Text-to-Image Generation

455 papers with code

Deblurring

392 papers with code

Conformal Prediction

239 papers with code

Face Detection

143 papers with code

Text Simplification

127 papers with code

See all 20 tasks

Logical Reasoning

Navigate

594 papers with code

Logical Reasoning

289 papers with code

Temporal Sequences

69 papers with code

Novel Concepts

65 papers with code

StrategyQA

20 papers with code

See all 23 tasks

Natural Language Inference

Natural Language Inference

809 papers with code

Answer Generation

94 papers with code

Visual Entailment

32 papers with code

Cross-Lingual Natural Language Inference

17 papers with code

Code Generation

Code Generation

606 papers with code

Code Translation

50 papers with code

Code Documentation Generation

6 papers with code

GitHub issue resolution

4 papers with code

Class-level Code Generation

3 papers with code

See all 6 tasks

Multi-Label Classification

Multi-Label Classification

444 papers with code

Missing Labels

48 papers with code

Extreme Multi-Label Classification

31 papers with code

Hierarchical Multi-label Classification

19 papers with code

Medical Code Prediction

16 papers with code

General Reinforcement Learning

Offline RL

291 papers with code

Model-based Reinforcement Learning

223 papers with code

Mathematical Reasoning

Mathematical Reasoning

267 papers with code

Math Word Problem Solving

79 papers with code

Formal Logic

15 papers with code

Geometry Problem Solving

11 papers with code

Abstract Algebra

6 papers with code

See all 8 tasks

Common Sense Reasoning

Common Sense Reasoning

310 papers with code

HellaSwag

17 papers with code

Winogrande

12 papers with code

Physical Commonsense Reasoning

6 papers with code

Riddle Sense

5 papers with code

See all 18 tasks

Visual Reasoning

Visual Reasoning

293 papers with code

Visual Commonsense Reasoning

33 papers with code

Video Question Answering

Video Question Answering

225 papers with code

Zero-Shot Video Question Answer

62 papers with code

Few-shot Video Question Answering

1 papers with code

Program Synthesis

Program Synthesis

167 papers with code

Program Repair

50 papers with code

Type prediction

44 papers with code

Value prediction

18 papers with code

Enumerative Search

5 papers with code

See all 6 tasks

Multi-Label Learning

Multi-Label Learning

91 papers with code

Missing Labels

48 papers with code

ARC

ARC

137 papers with code

Reconstruction

3D Human Reconstruction

58 papers with code

Single-View 3D Reconstruction

50 papers with code

4D reconstruction

21 papers with code

Single-Image-Based Hdr Reconstruction

4 papers with code

Reconstruction

2 papers with code

Mathematical Proofs

$\frac{1}{2} \sum_{i=1}^{n}\sum_{j=1}^{n}w_{ij}\left \| e_{i} - e_{j} \right \|^{2}_{2}$

Automated Theorem Proving

98 papers with code

Mathematical Proofs

26 papers with code

Robot Task Planning

Task Planning

84 papers with code

Robot Task Planning

21 papers with code

Arithmetic Reasoning

Arithmetic Reasoning

104 papers with code

Program Repair

Program Repair

50 papers with code

Fault localization

21 papers with code

Variable misuse

11 papers with code

Exception type

2 papers with code

Function-docstring mismatch

1 papers with code

See all 7 tasks

Math Word Problem Solving

Math Word Problem Solving

79 papers with code

Mathematical Question Answering

Math Word Problem Solving

79 papers with code

Multimodal Reasoning

Multimodal Reasoning

79 papers with code

Video-based Generative Performance Benchmarking

Video-based Generative Performance Benchmarking (Contextual Understanding)

16 papers with code

Video-based Generative Performance Benchmarking (Consistency)

15 papers with code

Video-based Generative Performance Benchmarking (Correctness of Information)

15 papers with code

Video-based Generative Performance Benchmarking (Detail Orientation))

15 papers with code

Video-based Generative Performance Benchmarking (Temporal Understanding)

15 papers with code

Systematic Generalization

Systematic Generalization

74 papers with code

Decision Making Under Uncertainty

Decision Making Under Uncertainty

52 papers with code

Uncertainty Visualization

5 papers with code

Natural Language Visual Grounding

Natural Language Visual Grounding

28 papers with code

Generative Visual Question Answering

Video-based Generative Performance Benchmarking

20 papers with code

Discrete Choice Models

Discrete Choice Models

16 papers with code

Causal Identification

Causal Identification

14 papers with code

Odd One Out

Odd One Out

12 papers with code

Geometry Problem Solving

Geometry Problem Solving

11 papers with code

Autonomous Navigation

Sequential Place Recognition

5 papers with code

Autonomous Web Navigation

2 papers with code

Autonomous Flight (Dense Forest)

1 papers with code

Abstract Argumentation

Abstract Argumentation

5 papers with code

Error Understanding

Error Understanding

5 papers with code

Image Paragraph Captioning

Image Paragraph Captioning

5 papers with code

Theory of Mind Modeling

Theory of Mind Modeling

5 papers with code

Analogical Similarity

Analogical Similarity

4 papers with code

Anachronisms

Anachronisms

3 papers with code

Assortment Optimization

Assortment Optimization

3 papers with code

Human Judgment Correlation

Human Judgment Correlation

3 papers with code

Human Judgment Classification

Human Judgment Classification

2 papers with code

Identify Odd Metapor

Identify Odd Metapor

2 papers with code

Commonsense Reasoning for RL

Commonsense Reasoning for RL

1 papers with code

Pre-election ratings estimation

Pre-election ratings estimation

1 papers with code