ConcurrentQA Benchmark

Introduced by Arora et al. in Reasoning over Public and Private Data in Retrieval-Based Systems

ConcurrentQA is a textual multi-hop QA benchmark to require concurrent retrieval over multiple data-distributions (i.e. Wikipedia and email data). The dataset follow the exact same schema and design as HotpotQA. The data set is downloadable here: It also contains model and result analysis code. This benchmark can also be used to study privacy when reasoning over data distributed in multiple privacy scopes --- i.e. Wikipedia in the public domain and emails in the private domain.

The following is a blog post about the benchmark:


Paper Code Results Date Stars

Dataset Loaders

No data loaders found. You can submit your data loader here.