Search Results for author: Vatsal Raina

Found 8 papers, 3 papers with code

"World Knowledge" in Multiple Choice Reading Comprehension

no code implementations13 Nov 2022 Adian Liusie, Vatsal Raina, Mark Gales

Two metrics are described: the expected number of options, which measures whether a passage-free system can identify the answer a question using world knowledge; and the contextual mutual information, which measures the importance of context for a given question.

General Knowledge Multiple-choice +1

Multiple-Choice Question Generation: Towards an Automated Assessment Framework

no code implementations23 Sep 2022 Vatsal Raina, Mark Gales

Applying n-gram based approaches is challenging for this form of system as the reference set is unlikely to capture the full range of possible questions and answer options.

Multiple-choice Pretrained Language Models +3

Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks

3 code implementations15 Jul 2021 Andrey Malinin, Neil Band, Ganshin, Alexander, German Chesnokov, Yarin Gal, Mark J. F. Gales, Alexey Noskov, Andrey Ploskonosov, Liudmila Prokhorenkova, Ivan Provilkov, Vatsal Raina, Vyas Raina, Roginskiy, Denis, Mariya Shmatova, Panos Tigas, Boris Yangel

However, many tasks of practical interest have different modalities, such as tabular data, audio, text, or sensor data, which offer significant challenges involving regression and discrete or continuous structured prediction.

Image Classification Machine Translation +4

An Initial Investigation of Non-Native Spoken Question-Answering

no code implementations9 Jul 2021 Vatsal Raina, Mark J. F. Gales

The SQA task considered in this paper is to extract the answer from a candidate$\text{'}$s spoken response to a question in a prompt-response style language assessment test.

Question Answering Reading Comprehension +1

Complementary Systems for Off-Topic Spoken Response Detection

no code implementations WS 2020 Vatsal Raina, Mark Gales, Kate Knill

This paper examines one form of spoken language assessment; whether the response from the candidate is relevant to the prompt provided.

Data Augmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.