JEEBench
Introduced by Arora et al. in Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models
JEEBench is a considerably more challenging benchmark dataset for evaluating the problem solving abilities of LLMs. It curates 515 challenging pre-engineering mathematics, physics and chemistry problems from the IIT JEE-Advanced Exam. Long-horizon reasoning on top of deep in-domain knowledge is essential for solving problems in this benchmark.
Source: Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language ModelsBenchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
JEEBench
|
GPT-4+CoT+Self-Consistency@8
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
Dataset Loaders
No data loaders found. You can
submit your data loader here.
No data loaders found. You can
submit your data loader here.
