Moving Beyond the Turing Test with the Allen AI Science Challenge

14 Apr 2016  ·  Carissa Schoenick, Peter Clark, Oyvind Tafjord, Peter Turney, Oren Etzioni ·

Given recent successes in AI (e.g., AlphaGo's victory against Lee Sedol in the game of GO), it's become increasingly important to assess: how close are AI systems to human-level intelligence? This paper describes the Allen AI Science Challenge---an approach towards that goal which led to a unique Kaggle Competition, its results, the lessons learned, and our next steps.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Question Answering Aristo Kaggle Allen AI 8th grade questions Cardal 1:1 Accuracy 59.31 # 1
Question Answering Aristo Kaggle Allen AI 8th grade questions Alejandro Mosquera 1:1 Accuracy 58.26 # 2

Methods


No methods listed for this paper. Add relevant methods here