Deep Relevance Ranking Using Enhanced Document-Query Interactions

EMNLP 2018  ·  Ryan McDonald, Georgios-Ioannis Brokos, Ion Androutsopoulos ·

We explore several new models for document relevance ranking, building upon the Deep Relevance Matching Model (DRMM) of Guo et al. (2016). Unlike DRMM, which uses context-insensitive encodings of terms and query-document term interactions, we inject rich context-sensitive encodings throughout our models, inspired by PACRR's (Hui et al., 2017) convolutional n-gram matching features, but extended in several ways including multiple views of query and document inputs. We test our models on datasets from the BIOASQ question answering challenge (Tsatsaronis et al., 2015) and TREC ROBUST 2004 (Voorhees, 2005), showing they outperform BM25-based baselines, DRMM, and PACRR.

PDF Abstract EMNLP 2018 PDF EMNLP 2018 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Ad-Hoc Information Retrieval TREC Robust04 POSIT-DRMM-MV MAP 0.271 # 11
P@20 0.389 # 11
nDCG@20 0.464 # 7
Ad-Hoc Information Retrieval TREC Robust04 PACRR MAP 0.258 # 12
P@20 0.374 # 14
nDCG@20 0.445 # 10

Methods


No methods listed for this paper. Add relevant methods here