The Neural Hype and Comparisons Against Weak Baselines

Recently, the machine learning community paused in a moment of self-reflection. In a widely discussed paper at ICLR 2018, Sculley et al. wrote: "We observe that the rate of empirical advancement may not have been matched by consistent increase in the level of empirical rigor across the field as a whole.".. (read more)

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK BENCHMARK
Ad-Hoc Information Retrieval TREC Robust04 Anserini BM25+RM3 MAP 0.302 # 3
P@20 0.4012 # 8

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet