Search Results for author:
Found 120 papers, 69 papers with code
Timeline Summarization based on Event Graph Compression via Time-Aware Optimal Transport
Timeline Summarization identifies major events from a news collection and describes them following temporal order, with key dates tagged.
It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books
Existing question answering (QA) techniques are created mainly to answer questions asked by humans.
Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative Comprehension
Through benchmarking with QG models, we show that the QG model trained on FairytaleQA is capable of asking high-quality and more diverse questions.
Large Language Models Can Self-Improve in Long-context Reasoning
Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning.
On the token distance modeling ability of higher RoPE attention dimension
We further demonstrate the correlation between the efficiency of length extrapolation and the extension of the high-dimensional attention allocation of these heads.
A Survey on the Honesty of Large Language Models
Honesty is a fundamental principle for aligning large language models (LLMs) with human values, requiring these models to recognize what they know and don't know and be able to faithfully express their knowledge.
Are LLM-based Recommenders Already the Best? Simple Scaled Cross-entropy Unleashes the Potential of Traditional Sequential Recommenders
Some studies have observed that LLMs, when fine-tuned by the cross-entropy (CE) loss with a full softmax, could achieve `state-of-the-art' performance in sequential recommendation.
An Energy-based Model for Word-level AutoCompletion in Computer-aided Translation
Existing work addresses this task through a classification model based on a neural network that maps the hidden vector of the input context into its corresponding label (i. e., the candidate target word is treated as a label).
Think out Loud: Emotion Deducing Explanation in Dialogues
Besides, EDEN can help LLMs achieve better recognition of emotions and causes, which explores a new research direction of explainable emotion understanding in dialogues.
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models
The task is question-answering: for each maze, a large language model reads the walkthrough and answers hundreds of mapping and navigation questions such as "How should you go to Attic from West of House?"
On Large Language Models' Hallucination with Regard to Known Facts
We reveal the different dynamics of the output token probabilities along the depths of layers between the correct and hallucinated cases.
Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation
Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating additional information from retrieval.
Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions
This work introduces an original and practical paradigm for narrative comprehension, stemming from the characteristics that individual passages within narratives tend to be more cohesively related than isolated.
Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy
Factual inconsistencies pose a significant hurdle for the faithful summarization by generative models.
Previously on the Stories: Recap Snippet Identification for Story Reading
Similar to the "previously-on" scenes in TV shows, recaps can help book reading by recalling the readers' memory about the important elements in previous texts to better understand the ongoing plot.
Plot Retrieval as an Assessment of Abstract Semantic Association
Readers usually only give an abstract and vague description as the query based on their own understanding, summaries, or speculations of the plot, which requires the retrieval model to have a strong ability to estimate the abstract semantic associations between the query and candidate plots.
Personality Understanding of Fictional Characters during Book Reading
As readers engage with a story, their understanding of a character evolves based on new events and information; and multiple fine-grained aspects of personalities can be perceived.
Can Large Language Models Play Text Games Well? Current State-of-the-Art and Open Questions
Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users.
Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models
COPAINT also uses the Bayesian framework to jointly modify both revealed and unrevealed regions, but approximates the posterior distribution in a way that allows the errors to gradually drop to zero throughout the denoising steps, thus strongly penalizing any mismatches with the reference image.
Explicit Planning Helps Language Models in Logical Reasoning
In this paper, we propose LEAP, a novel system that uses language models to perform multi-step logical reasoning and incorporates explicit planning into the inference procedure.
MetaNO: How to Transfer Your Knowledge on Learning Hidden Physics
Gradient-based meta-learning methods have primarily been applied to classical machine learning tasks such as image classification.
Few-Shot Character Understanding in Movies as an Assessment to Meta-Learning of Theory-of-Mind
Our dataset consists of ~1, 000 parsed movie scripts, each corresponding to a few-shot character understanding task that requires models to mimic humans' ability of fast digesting characters with a few starting scenes in a new movie.
Question-Interlocutor Scope Realized Graph Modeling over Key Utterances for Dialogue Reading Comprehension
Although these tasks are effective, there are still urging problems: (1) randomly masking speakers regardless of the question cannot map the speaker mentioned in the question to the corresponding speaker in the dialogue, and ignores the speaker-centric nature of utterances.
MBTI Personality Prediction for Fictional Characters Using Movie Scripts
An NLP model that understands stories should be able to understand the characters in them.
JECC: Commonsense Reasoning Tasks Derived from Interactive Fictions
Hence, in order to achieve higher performance on our tasks, models need to effectively utilize such functional knowledge to infer the outcomes of actions, rather than relying solely on memorizing facts.
Revisiting the Roles of "Text" in Text Games
Text games present opportunities for natural language understanding (NLU) methods to tackle reinforcement learning (RL) challenges.
Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition
We propose novel AI-empowered chat bots for learning as conversation where a user does not read a passage but gains information and knowledge through conversation with a teacher bot.
A Survey of Machine Narrative Reading Comprehension Assessments
As the body of research on machine narrative comprehension grows, there is a critical need for consideration of performance assessment strategies as well as the depth and scope of different benchmark tasks.
FaithDial: A Faithful Benchmark for Information-Seeking Dialogue
The goal of information-seeking dialogue is to respond to seeker queries with natural language utterances that are grounded on knowledge sources.
On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?
Knowledge-grounded conversational models are known to suffer from producing factually invalid statements, a phenomenon commonly called hallucination.
TVShowGuess: Character Comprehension in Stories as Speaker Guessing
We propose a new task for assessing machines' skills of understanding fictional characters in narrative stories.
Probing Script Knowledge from Pre-Trained Models
Script knowledge is critical for humans to understand the broad daily tasks and routine activities in the world.
The Art of Prompting: Event Detection based on Type Specific Prompts
We compare various forms of prompts to represent event types and develop a unified framework to incorporate the event type specific prompts for supervised, few-shot, and zero-shot event detection.
Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric Summarization
Generating educational questions of fairytales or storybooks is vital for improving children's literacy ability.
Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension
Through benchmarking with QG models, we show that the QG model trained on FairytaleQA is capable of asking high-quality and more diverse questions.
Ranked #1 on
Question Generation
on FairytaleQA
Linking Emergent and Natural Languages via Corpus Transfer
In this work, we propose a novel way to establish such a link by corpus transfer, i. e. pretraining on a corpus of emergent language for downstream natural language tasks, which is in contrast to prior work that directly transfers speaker and listener parameters.
Efficient Long Sequence Encoding via Synchronization
Pre-trained Transformer models have achieved successes in a wide range of NLP tasks, but are inefficient when dealing with long input sequences.
StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement
Despite its benefits for children's skill development and parent-child bonding, many parents do not often engage in interactive storytelling by having story-related dialogues with their child due to limited availability or challenges in coming up with appropriate questions.
Understanding Interlocking Dynamics of Cooperative Rationalization
The selection mechanism is commonly integrated into the model itself by specifying a two-component cascaded system consisting of a rationale generator, which makes a binary selection of the input features (which is the rationale), and a predictor, which predicts the output based only on the selected features.
Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding
Event extraction is typically modeled as a multi-class classification problem where event types and argument roles are treated as atomic symbols.
Feudal Reinforcement Learning by Reading Manuals
The manager agent is a multi-hop plan generator dealing with high-level abstract information and generating a series of sub-goals in a backward manner.
It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books
Existing question answering (QA) techniques are created mainly to answer questions asked by humans.
Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study
Recent advancements in open-domain question answering (ODQA), i. e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets.
Complementary Evidence Identification in Open-Domain Question Answering
This paper proposes a new problem of complementary evidence identification for open-domain question answering (QA).
CASS: Towards Building a Social-Support Chatbot for Online Health Community
Chatbots systems, despite their popularity in today's HCI and CSCW research, fall short for one of the two reasons: 1) many of the systems use a rule-based dialog flow, thus they can only respond to a limited number of pre-defined inputs with pre-scripted responses; or 2) they are designed with a focus on single-user scenarios, thus it is unclear how these systems may affect other users or the community.
Benchmarking Commercial Intent Detection Services with Practice-Driven Evaluations
Secondly, even with large training data, the intent detection models can see a different distribution of test data when being deployed in the real world, leading to poor accuracy.
Leveraging Abstract Meaning Representation for Knowledge Base Question Answering
Knowledge base question answering (KBQA)is an important task in Natural Language Processing.
Interpretable Visual Reasoning via Induced Symbolic Space
Finally, we achieve a higher level of interpretability by imposing OCCAM on the objects represented in the induced symbolic concept space.
Ranked #3 on
Visual Question Answering (VQA)
on CLEVR
Multilingual BERT Post-Pretraining Alignment
We propose a simple method to align multilingual contextual embeddings as a post-pretraining step for improved zero-shot cross-lingual transferability of the pretrained models.
Deriving Commonsense Inference Tasks from Interactive Fictions
Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems.
Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning
Interactive Fiction (IF) games with real human-written natural language texts provide a new natural evaluation for language understanding techniques.
MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning
Multi-hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi-hop rule, which corresponds to a chain of relationships.
Leveraging Semantic Parsing for Relation Linking over Knowledge Bases
Knowledgebase question answering systems are heavily dependent on relation extraction and linking modules.
Ranked #1 on
Relation Linking
on QALD-7
Frustratingly Hard Evidence Retrieval for QA Over Books
A lot of progress has been made to improve question answering (QA) in recent years, but the special problem of QA over narrative book stories has not been explored in-depth.
Learning to Recover Reasoning Chains for Multi-Hop Question Answering via Cooperative Games
We propose the new problem of learning to recover reasoning chains from weakly supervised signals, i. e., the question-answer pairs.
Invariant Rationalization
Selective rationalization improves neural network interpretability by identifying a small subset of input features -- the rationale -- that best explains or supports the prediction.
Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation
We consider the problem of unsupervised domain adaptation for semantic segmentation by easing the domain shift between the source domain (synthetic data) and the target domain (real data) in this work.
Ranked #8 on
Semantic Segmentation
on DensePASS
Generalizable Resource Allocation in Stream Processing via Deep Reinforcement Learning
In this paper, we present a graph-aware encoder-decoder framework to learn a generalizable resource allocation strategy that can properly distribute computation tasks of stream processing graphs unobserved from training data.
Leveraging Dependency Forest for Neural Medical Relation Extraction
Medical relation extraction discovers relations between entity mentions in text, such as research articles.
Context-Aware Conversation Thread Detection in Multi-Party Chat
In multi-party chat, it is common for multiple conversations to occur concurrently, leading to intermingled conversation threads in chat logs.
Do Multi-hop Readers Dream of Reasoning Chains?
General Question Answering (QA) systems over texts require the multi-hop reasoning capability, i. e. the ability to reason with information collected from multiple passages to derive the answer.
Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control
Moreover, we explicitly control the rationale complement via an adversary so as not to leave any useful information out of the selection.
A Game Theoretic Approach to Class-wise Selective Rationalization
Selection of input features such as relevant pieces of text has become a common technique of highlighting how complex neural predictors operate.
An Efficient and Margin-Approaching Zero-Confidence Adversarial Attack
The second paradigm, called the zero-confidence attack, finds the smallest perturbation needed to cause mis-classification, also known as the margin of an input feature.
Simple yet Effective Bridge Reasoning for Open-Domain Multi-Hop Question Answering
To resolve this issue, we introduce a new sub-problem of open-domain multi-hop QA, which aims to recognize the bridge (\emph{i. e.}, the anchor that links to the answer passage) from the context of a set of start passages with a reading comprehension model.
Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
Multi-hop question answering (QA) requires an information retrieval (IR) system that can find \emph{multiple} supporting evidence needed to answer the question, making the retrieval process very challenging.
Neural Correction Model for Open-Domain Named Entity Recognition
In this work, to address the low precision and recall problems, we first utilize DBpedia as the source of distant supervision to annotate abstracts from Wikipedia and design a neural correction model trained with a human-annotated NER dataset, DocRED, to correct the false entity labels.
Out-of-Domain Detection for Low-Resource Text Classification Tasks
Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task.
Meta Reasoning over Knowledge Graphs
The ability to reason over learned knowledge is an innate ability for humans and humans can easily master new reasoning rules with only a few demonstrations.
Multi-Granular Text Encoding for Self-Explaining Categorization
Self-explaining text categorization requires a classifier to make a prediction along with supporting evidence.
TWEETQA: A Social Media Focused Question Answering Dataset
With social media becoming increasingly pop-ular on which lots of news and real-time eventsare reported, developing automated questionanswering systems is critical to the effective-ness of many applications that rely on real-time knowledge.
Self-Supervised Learning for Contextualized Extractive Summarization
Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss, which does not explicitly capture the global context at the document level.
Group Chat Ecology in Enterprise Instant Messaging: How Employees Collaborate Through Multi-User Chat Channels on Slack
We cross-referenced 117 project teams and their team-based Slack channels and identified 57 teams that appeared in both datasets, then we built a regression model to reveal the relationship between these group communication styles and the project team performance.
Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network
Previous cross-lingual knowledge graph (KG) alignment studies rely on entity embeddings derived only from monolingual KG structural information, which may fail at matching entities that have different facts in two KGs.
Improving Question Answering over Incomplete KBs with Knowledge-Aware Reader
We propose a new end-to-end question answering model, which learns to aggregate answer evidence from an incomplete knowledge base (KB) and a set of retrieved text snippets.
Selection Bias Explorations and Debias Methods for Natural Language Sentence Matching Datasets
Natural Language Sentence Matching (NLSM) has gained substantial attention from both academics and the industry, and rich public datasets contribute a lot to this process.
DAG-GNN: DAG Structure Learning with Graph Neural Networks
Learning a faithful directed acyclic graph (DAG) from samples of a joint distribution is a challenging combinatorial problem, owing to the intractable search space superexponential in the number of graph nodes.
A Hybrid Approach with Optimization and Metric-based Meta-Learner for Few-Shot Learning
The task-specific classifiers are required to be homogeneous-structured to ease the parameter prediction, so the meta-learning approaches could only handle few-shot learning problems where the tasks share a uniform number of classes.
Hybrid Reinforcement Learning with Expert State Sequences
The empirical results show that (1) the agents are able to leverage state expert sequences to learn faster than pure reinforcement learning baselines, (2) our tensor-based action inference model is advantageous compared to standard deep neural networks in inferring expert actions, and (3) the hybrid policy optimization objective is robust against noise in expert state sequences.
Imposing Label-Relational Inductive Bias for Extremely Fine-Grained Entity Typing
Existing entity typing systems usually exploit the type hierarchy provided by knowledge base (KB) schema to model label correlations and thus improve the overall performance.
Ranked #3 on
Entity Typing
on Ontonotes v5 (English)
Sentence Embedding Alignment for Lifelong Relation Extraction
We formulate such a challenging problem as lifelong relation extraction and investigate memory-efficient incremental learning methods without catastrophically forgetting knowledge learned from previous tasks.
Extracting Multiple-Relations in One-Pass with Pre-Trained Transformers
Most approaches to extraction multiple relations from a paragraph require multiple passes over the paragraph.
Ranked #19 on
Relation Extraction
on SemEval-2010 Task-8
Few-shot Learning with Meta Metric Learners
Our meta metric learning approach consists of task-specific learners, that exploit metric learning to handle flexible labels, and a meta learner, that discovers good parameters and gradient decent to specify the metrics in task-specific learners.
Learning Corresponded Rationales for Text Matching
The ability to predict matches between two sources of text has a number of applications including natural language inference (NLI) and question answering (QA).
Improving Natural Language Inference Using External Knowledge in the Science Questions Domain
To address this, we present a combination of techniques that harness knowledge graphs to improve performance on the NLI problem in the science questions domain.
Improving Reinforcement Learning Based Image Captioning with Natural Language Prior
Recently, Reinforcement Learning (RL) approaches have demonstrated advanced performance in image captioning by directly optimizing the metric used for testing.
Exploring Graph-structured Passage Representation for Multi-hop Reading Comprehension with Graph Neural Networks
Multi-hop reading comprehension focuses on one type of factoid question, where a system needs to properly integrate multiple pieces of evidence to correctly answer a question.
Ranked #2 on
Question Answering
on COMPLEXQUESTIONS
Deriving Machine Attention from Human Rationales
Attention-based models are successful when trained on large amounts of data.
One-Shot Relational Learning for Knowledge Graphs
Knowledge graphs (KGs) are the key components of various natural language processing applications.
Exploiting Rich Syntactic Information for Semantic Parsing with Graph-to-Sequence Model
Existing neural semantic parsers mainly utilize a sequence encoder, i. e., a sequential LSTM, to extract word order features while neglecting other valuable syntactic information such as dependency graph or constituent trees.
Spatial-Temporal Synergic Residual Learning for Video Person Re-Identification
We present a novel method - Spatial-Temporal Synergic Residual Network (STSRN) for this problem.
Scheduled Policy Optimization for Natural Language Communication with Intelligent Agents
We investigate the task of learning to follow natural language instructions by jointly reasoning with visual observations and language inputs.
A Co-Matching Model for Multi-choice Reading Comprehension
Multi-choice reading comprehension is a challenging task, which involves the matching between a passage and a question-answer pair.
Diverse Few-Shot Text Classification with Multiple Metrics
We study few-shot learning in natural language domains.
Image Super-Resolution via Dual-State Recurrent Networks
Advances in image super-resolution (SR) have recently benefited significantly from rapid developments in deep neural networks.
Ranked #47 on
Image Super-Resolution
on BSD100 - 4x upscaling
NE-Table: A Neural key-value table for Named Entities
Many Natural Language Processing (NLP) tasks depend on using Named Entities (NEs) that are contained in texts and in external knowledge sources.
Knowledge Base Relation Detection via Multi-View Matching
Relation detection is a core component for Knowledge Base Question Answering (KBQA).
Faster Reinforcement Learning with Expert State Sequences
In this paper, we consider a realistic and more difficult sce- nario where a reinforcement learning agent only has access to the state sequences of an expert, while the expert actions are not available.
A Neural Method for Goal-Oriented Dialog Systems to interact with Named Entities
Many goal-oriented dialog tasks, especially ones in which the dialog system has to interact with external knowledge sources such as databases, have to handle a large number of Named Entities (NEs).
Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering
We propose two methods, namely, strength-based re-ranking and coverage-based re-ranking, to make use of the aggregated evidence from different passages to better determine the answer.
Ranked #1 on
Open-Domain Question Answering
on Quasar
Dilated Recurrent Neural Networks
To provide a theory-based quantification of the architecture's advantages, we introduce a memory capacity measure, the mean recurrent length, which is more suitable for RNNs with long skip connections than existing measures.
Ranked #24 on
Sequential Image Classification
on Sequential MNIST
R$^3$: Reinforced Reader-Ranker for Open-Domain Question Answering
Second, we propose a novel method that jointly trains the Ranker along with an answer-generation Reader model, based on reinforcement learning.
Ranked #4 on
Open-Domain Question Answering
on Quasar
Robust Task Clustering for Deep Many-Task Learning
We propose a new method to measure task similarities with cross-task transfer performance matrix for the deep learning scenario.
Improved Neural Relation Detection for Knowledge Base Question Answering
Relation detection is a core component for many NLP applications including Knowledge Base Question Answering (KBQA).
A Structured Self-attentive Sentence Embedding
This paper proposes a new model for extracting an interpretable sentence embedding by introducing self-attention.
Comparative Study of CNN and RNN for Natural Language Processing
Deep neural networks (DNN) have revolutionized the field of natural language processing (NLP).
End-to-End Answer Chunk Extraction and Ranking for Reading Comprehension
This paper proposes dynamic chunk reader (DCR), an end-to-end neural reading comprehension (RC) model that is able to extract and rank a set of answer candidates from a given document to answer questions.
Ranked #49 on
Question Answering
on SQuAD1.1 dev
Simple Question Answering by Attentive Convolutional Neural Network
In fact selection, we match the subject entity in a fact candidate with the entity mention in the question by a character-level convolutional neural network (char-CNN), and match the predicate in that fact with the question by a word-level CNN (word-CNN).
Embedding Lexical Features via Low-Rank Tensors
Modern NLP models rely heavily on engineered features, which often combine word and contextual information into complex lexical features.
Leveraging Sentence-level Information with Encoder LSTM for Semantic Slot Filling
Recurrent Neural Network (RNN) and one of its specific architectures, Long Short-Term Memory (LSTM), have been widely used for sequence labeling.
Improved Relation Extraction with Feature-Rich Compositional Embedding Models
We propose a Feature-rich Compositional Embedding Model (FCM) for relation extraction that is expressive, generalizes to new domains, and is easy-to-implement.
Ranked #1 on
Relation Extraction
on ACE 2005
(Cross Sentence metric)
Learning Composition Models for Phrase Embeddings
We propose efficient unsupervised and task-specific learning objectives that scale our model to large datasets.
Accelerated Mini-batch Randomized Block Coordinate Descent Method
When the regularization function is block separable, we can solve the minimization problems in a randomized block coordinate descent (RBCD) manner.
