NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval

Pseudo-relevance feedback (PRF) is commonly used to boost the performance of traditional information retrieval (IR) models by using top-ranked documents to identify and weight new query terms, thereby reducing the effect of query-document vocabulary mismatches. While neural retrieval models have recently demonstrated strong results for ad-hoc retrieval, combining them with PRF is not straightforward due to incompatibilities between existing PRF approaches and neural architectures. To bridge this gap, we propose an end-to-end neural PRF framework that can be used with existing neural IR models by embedding different neural models as building blocks. Extensive experiments on two standard test collections confirm the effectiveness of the proposed NPRF framework in improving the performance of two state-of-the-art neural IR models.

PDF Abstract EMNLP 2018 PDF EMNLP 2018 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Ad-Hoc Information Retrieval TREC Robust04 NPRF-DRMM MAP 0.2904 # 5
P@20 0.4064 # 6
nDCG@20 0.4502 # 9
Ad-Hoc Information Retrieval TREC Robust04 NPRF-KNRM MAP 0.2846 # 7
P@20 0.3926 # 10
nDCG@20 0.4327 # 13
Ad-Hoc Information Retrieval TREC Robust04 KNRM MAP 0.2464 # 14
P@20 0.3510 # 15
nDCG@20 0.3989 # 16

Methods


No methods listed for this paper. Add relevant methods here