Search Results for author: Eric Nyberg

Found 53 papers, 18 papers with code

Attribution Regularization for Multimodal Paradigms

no code implementations2 Apr 2024 Sahiti Yerramilli, Jayant Sravan Tamarapalli, Jonathan Francis, Eric Nyberg

This research project aims to address these challenges by proposing a novel regularization term that encourages multimodal models to effectively utilize information from all modalities when making decisions.

Decision Making

VISREAS: Complex Visual Reasoning with Unanswerable Questions

no code implementations23 Feb 2024 Syeda Nahida Akter, Sangwu Lee, Yingshan Chang, Yonatan Bisk, Eric Nyberg

The unique feature of this task, validating question answerability with respect to an image before answering, and the poor performance of state-of-the-art models inspired the design of a new modular baseline, LOGIC2VISION that reasons by producing and executing pseudocode without any external modules to generate the answer.

Question Answering Visual Question Answering +1

Self-Imagine: Effective Unimodal Reasoning with Multimodal Models using Self-Imagination

no code implementations16 Jan 2024 Syeda Nahida Akter, Aman Madaan, Sangwu Lee, Yiming Yang, Eric Nyberg

The potential of Vision-Language Models (VLMs) often remains underutilized in handling complex text-based problems, particularly when these problems could benefit from visual representation.

GSM8K Language Modelling +1

Difference-Masking: Choosing What to Mask in Continued Pretraining

1 code implementation23 May 2023 Alex Wilf, Syeda Nahida Akter, Leena Mathur, Paul Pu Liang, Sheryl Mathew, Mengrou Shou, Eric Nyberg, Louis-Philippe Morency

The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks.

Self-Supervised Learning

Chain-of-Skills: A Configurable Model for Open-domain Question Answering

1 code implementation4 May 2023 Kaixin Ma, Hao Cheng, Yu Zhang, Xiaodong Liu, Eric Nyberg, Jianfeng Gao

Our approach outperforms recent self-supervised retrievers in zero-shot evaluations and achieves state-of-the-art fine-tuned retrieval performance on NQ, HotpotQA and OTT-QA.

Open-Domain Question Answering Retrieval +1

Using Implicit Feedback to Improve Question Generation

no code implementations26 Apr 2023 Hugo Rodrigues, Eric Nyberg, Luisa Coheur

Each generated question, after being corrected by the user, is used as a new seed in the next iteration, so more patterns are created each time.

Question Generation Question-Generation +1

InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers

no code implementations8 Jan 2023 Leonid Boytsov, Preksha Patel, Vivek Sourabh, Riddhi Nisar, Sayani Kundu, Ramya Ramanathan, Eric Nyberg

Unlike InPars, InPars-light uses 7x-100x smaller ranking models and only a freely available language model BLOOM, which -- as we found out -- produced more accurate rankers compared to a proprietary GPT-3 model.

Language Modelling Re-Ranking +1

Knowledge-driven Scene Priors for Semantic Audio-Visual Embodied Navigation

no code implementations21 Dec 2022 Gyan Tatiya, Jonathan Francis, Luca Bondi, Ingrid Navarro, Eric Nyberg, Jivko Sinapov, Jean Oh

We also define a new audio-visual navigation sub-task, where agents are evaluated on novel sounding objects, as opposed to unheard clips of known objects.

Visual Navigation

Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving

no code implementations16 Dec 2022 Jonathan Francis, Bingqing Chen, Weiran Yao, Eric Nyberg, Jean Oh

The feasibility of collecting a large amount of expert demonstrations has inspired growing research interests in learning-to-drive settings, where models learn by imitating the driving behaviour from experts.

Autonomous Driving Density Estimation +1

Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge

2 code implementations22 Oct 2022 Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources.

Open-Domain Question Answering

Coalescing Global and Local Information for Procedural Text Understanding

1 code implementation COLING 2022 Kaixin Ma, Filip Ilievski, Jonathan Francis, Eric Nyberg, Alessandro Oltramari

In this paper, we propose Coalescing Global and Local Information (CGLI), a new model that builds entity- and timestep-aware input representations (local input) considering the whole context (global input), and we jointly model the entity states with a structured prediction objective (global output).

Procedural Text Understanding Structured Prediction

Understanding Performance of Long-Document Ranking Models through Comprehensive Evaluation and Leaderboarding

3 code implementations4 Jul 2022 Leonid Boytsov, David Akinpelu, Tianyi Lin, Fangwei Gao, Yutian Zhao, Jeffrey Huang, Eric Nyberg

Most other models had poor zero-shot performance (sometimes at a random baseline level) but outstripped MaxP by as much 13-28\% after finetuning.

Benchmarking Document Ranking

Table Retrieval May Not Necessitate Table-specific Model Design

1 code implementation NAACL (SUKI) 2022 Zhiruo Wang, Zhengbao Jiang, Eric Nyberg, Graham Neubig

In this work, we focus on the task of table retrieval, and ask: "is table-specific model design necessary for table retrieval, or can a simpler text-based model be effectively used to achieve a similar result?"

Hard Attention Natural Questions +2

Open Domain Question Answering with A Unified Knowledge Interface

1 code implementation ACL 2022 Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge.

Data-to-Text Generation Natural Questions +2

Safe Autonomous Racing via Approximate Reachability on Ego-vision

no code implementations14 Oct 2021 Bingqing Chen, Jonathan Francis, Jean Oh, Eric Nyberg, Sylvia L. Herbert

Given the nature of the task, autonomous agents need to be able to 1) identify and avoid unsafe scenarios under the complex vehicle dynamics, and 2) make sub-second decision in a fast-changing environment.

Autonomous Driving Reinforcement Learning (RL) +1

Learn-to-Race: A Multimodal Control Environment for Autonomous Racing

1 code implementation ICCV 2021 James Herman, Jonathan Francis, Siddha Ganju, Bingqing Chen, Anirudh Koul, Abhinav Gupta, Alexey Skabelkin, Ivan Zhukov, Max Kumskoy, Eric Nyberg

Existing research on autonomous driving primarily focuses on urban driving, which is insufficient for characterising the complex driving behaviour underlying high-speed racing.

Autonomous Driving Trajectory Prediction

Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering

1 code implementation7 Nov 2020 Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari

Guided by a set of hypotheses, the framework studies how to transform various pre-existing knowledge resources into a form that is most effective for pre-training models.

Language Modelling Question Answering

Flexible retrieval with NMSLIB and FlexNeuART

2 code implementations EMNLP (NLPOSS) 2020 Leonid Boytsov, Eric Nyberg

Our objective is to introduce to the NLP community an existing k-NN search library NMSLIB, a new retrieval toolkit FlexNeuART, as well as their integration capabilities.

Re-Ranking Retrieval

Bend but Don't Break? Multi-Challenge Stress Test for QA Models

no code implementations WS 2019 Hemant Pugaliya, James Route, Kaixin Ma, Yixuan Geng, Eric Nyberg

The field of question answering (QA) has seen rapid growth in new tasks and modeling approaches in recent years.

Question Answering

Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering

no code implementations WS 2019 Kaixin Ma, Jonathan Francis, Quanyang Lu, Eric Nyberg, Alessandro Oltramari

Non-extractive commonsense QA remains a challenging AI task, as it requires systems to reason about, synthesize, and gather disparate pieces of information, in order to generate responses to queries.

Common Sense Reasoning Question Answering +1

Pruning Algorithms for Low-Dimensional Non-metric k-NN Search: A Case Study

no code implementations8 Oct 2019 Leonid Boytsov, Eric Nyberg

We consider two known data-driven approaches to extend these rules to non-metric spaces: TriGen and a piece-wise linear approximation of the pruning rule.

Retrieval

Accurate and Fast Retrieval for Complex Non-metric Data via Neighborhood Graphs

no code implementations8 Oct 2019 Leonid Boytsov, Eric Nyberg

We demonstrate that a graph-based search algorithm-relying on the construction of an approximate neighborhood graph-can directly work with challenging non-metric and/or non-symmetric distances without resorting to metric-space mapping and/or distance symmetrization, which, in turn, lead to substantial performance degradation.

graph construction Retrieval

Ontology-Based Retrieval \& Neural Approaches for BioASQ Ideal Answer Generation

no code implementations WS 2018 Ashwin Naresh Kumar, Harini Kesavamoorthy, Madhura Das, Pramati Kalwad, Ch, Khyathi u, Teruko Mitamura, Eric Nyberg

The ever-increasing magnitude of biomedical information sources makes it difficult and time-consuming for a human researcher to find the most relevant documents and pinpointed answers for a specific question or topic when using only a traditional search engine.

Abstractive Text Summarization Answer Generation +4

Extraction Meets Abstraction: Ideal Answer Generation for Biomedical Questions

no code implementations WS 2018 Yutong Li, Nicholas Gekakis, Qiuze Wu, Boyue Li, Ch, Khyathi u, Eric Nyberg

The growing number of biomedical publications is a challenge for human researchers, who invest considerable effort to search for relevant documents and pinpointed answers.

Abstractive Text Summarization Answer Generation +5

BioAMA: Towards an End to End BioMedical Question Answering System

no code implementations WS 2018 Vasu Sharma, Nitish Kulkarni, Srividya Pranavi, Gabriel Bayomi, Eric Nyberg, Teruko Mitamura

In this paper, we present a novel Biomedical Question Answering system, BioAMA: {``}Biomedical Ask Me Anything{''} on task 5b of the annual BioASQ challenge.

Natural Language Inference NER +4

Code-Mixed Question Answering Challenge: Crowd-sourcing Data and Techniques

no code implementations WS 2018 Ch, Khyathi u, Ekaterina Loginova, Vishal Gupta, Josef van Genabith, G{\"u}nter Neumann, Manoj Chinnakotla, Eric Nyberg, Alan W. black

As a first step towards fostering research which supports CM in NLP applications, we systematically crowd-sourced and curated an evaluation dataset for factoid question answering in three CM languages - Hinglish (Hindi+English), Tenglish (Telugu+English) and Tamlish (Tamil+English) which belong to two language families (Indo-Aryan and Dravidian).

Question Answering Sentence

Comparative Analysis of Neural QA models on SQuAD

no code implementations WS 2018 Soumya Wadhwa, Khyathi Raghavi Chandu, Eric Nyberg

The task of Question Answering has gained prominence in the past few decades for testing the ability of machines to understand natural language.

Information Retrieval Question Answering +2

Towards Inference-Oriented Reading Comprehension: ParallelQA

no code implementations WS 2018 Soumya Wadhwa, Varsha Embar, Matthias Grabmair, Eric Nyberg

In this paper, we investigate the tendency of end-to-end neural Machine Reading Comprehension (MRC) models to match shallow patterns rather than perform inference-oriented reasoning on RC benchmarks.

Machine Reading Comprehension

CMU LiveMedQA at TREC 2017 LiveQA: A Consumer Health Question Answering System

no code implementations15 Nov 2017 Yuan Yang, Jingcheng Yu, Ye Hu, Xiaoyao Xu, Eric Nyberg

In this paper, we present LiveMedQA, a question answering system that is optimized for consumer health question.

Answer Generation General Classification +4

Steering Output Style and Topic in Neural Response Generation

1 code implementation EMNLP 2017 Di Wang, Nebojsa Jojic, Chris Brockett, Eric Nyberg

We propose simple and flexible training and decoding methods for influencing output style and topic in neural encoder-decoder based language generation.

Response Generation Text Generation

Shakespearizing Modern Language Using Copy-Enriched Sequence to Sequence Models

1 code implementation WS 2017 Harsh Jhamtani, Varun Gangal, Eduard Hovy, Eric Nyberg

Variations in writing styles are commonly used to adapt the content to a specific context, audience, or purpose.

How Would You Say It? Eliciting Lexically Diverse Dialogue for Supervised Semantic Parsing

no code implementations WS 2017 Ravich, Abhilasha er, Thomas Manzini, Matthias Grabmair, Graham Neubig, Jonathan Francis, Eric Nyberg

Wang et al. (2015) proposed a method to build semantic parsing datasets by generating canonical utterances using a grammar and having crowdworkers paraphrase them into natural wording.

Semantic Parsing

Tackling Biomedical Text Summarization: OAQA at BioASQ 5B

no code implementations WS 2017 Khyathi u, Aakanksha Naik, Ch, Aditya rasekar, Zi Yang, Niloy Gupta, Eric Nyberg

In this paper, we describe our participation in phase B of task 5b of the fifth edition of the annual BioASQ challenge, which includes answering factoid, list, yes-no and summary questions from biomedical data.

Answer Generation Clustering +4

Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Models

2 code implementations4 Jul 2017 Harsh Jhamtani, Varun Gangal, Eduard Hovy, Eric Nyberg

Variations in writing styles are commonly used to adapt the content to a specific context, audience, or purpose.

Structural Embedding of Syntactic Trees for Machine Comprehension

no code implementations EMNLP 2017 Rui Liu, Junjie Hu, Wei Wei, Zi Yang, Eric Nyberg

Deep neural networks for machine comprehension typically utilizes only word or character embeddings without explicitly taking advantage of structured linguistic information such as constituency trees and dependency trees.

Question Answering Reading Comprehension

LAPPS/Galaxy: Current State and Next Steps

no code implementations WS 2016 Nancy Ide, Keith Suderman, Eric Nyberg, James Pustejovsky, Marc Verhagen

The US National Science Foundation (NSF) SI2-funded LAPPS/Galaxy project has developed an open-source platform for enabling complex analyses while hiding complexities associated with underlying infrastructure, that can be accessed through a web interface, deployed on any Unix system, or run from the cloud.

Permutation Search Methods are Efficient, Yet Faster Search is Possible

1 code implementation10 Jun 2015 Bilegsaikhan Naidan, Leonid Boytsov, Eric Nyberg

The underpinning assumption is that, for both metric and non-metric spaces, the distance between permutations is a good proxy for the distance between original points.

Retrieval

The Language Application Grid

no code implementations LREC 2014 Nancy Ide, James Pustejovsky, Christopher Cieri, Eric Nyberg, Di Wang, Keith Suderman, Marc Verhagen, Jonathan Wright

The Language Application (LAPPS) Grid project is establishing a framework that enables language service discovery, composition, and reuse and promotes sustainability, manageability, usability, and interoperability of natural language Processing (NLP) components.

Machine Translation Question Answering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.