Search Results for author:
Found 24 papers, 9 papers with code
Perhaps PTLMs Should Go to School – A Task to Assess Open Book and Closed Book QA
Our goal is to deliver a new task and leaderboard to stimulate research on question answering and pre-trained language models (PTLMs) to understand a significant instructional document, e. g., an introductory college textbook or a manual.
Evaluating Very Long-Term Conversational Memory of LLM Agents
Using this pipeline, we collect LoCoMo, a dataset of very long-term conversations, each encompassing 300 turns and 9K tokens on avg., over up to 35 sessions.
Integrating Pre-Trained Language Model with Physical Layer Communications
The burgeoning field of on-device AI communication, where devices exchange information directly through embedded foundation models, such as language models (LMs), requires robust, efficient, and generalizable communication frameworks.
PLUG: Leveraging Pivot Language in Cross-Lingual Instruction Tuning
Instruction tuning has remarkably advanced large language models (LLMs) in understanding and responding to diverse human instructions.
Making Large Language Models Better Data Creators
In our experiments we demonstrate that instruction-following LLMs are highly cost-effective data creators, and that models trained with these data exhibit performance better than those trained with human-labeled data (by up to 17. 5%) on out-of-distribution evaluation, while maintaining comparable performance on in-distribution tasks.
Ranked #3 on
Visual Question Answering
on ViP-Bench
Analyzing Norm Violations in Live-Stream Chat
Previous approaches to detecting toxic language and norm violations have been primarily concerned with conversations from online forums and social media, such as Reddit and Twitter.
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning
This shows that prior semantic knowledge is unnecessary; instead, LLMs can leverage the existing patterns in the context to achieve such performance.
Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality
Human communication relies on common ground (CG), the mutual knowledge and beliefs shared by participants, to produce coherent and interesting conversations.
XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models
Explanation-based model debugging aims to resolve spurious biases by showing human users explanations of model behavior, asking users to give feedback on the behavior, then using the feedback to update the model.
Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model
In this work, we propose a realistic semantic network called seq2seq-SC, designed to be compatible with 5G NR and capable of working with generalized text datasets using a pre-trained language model.
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
Pre-trained language models are still far from human performance in tasks that need understanding of properties (e. g. appearance, measurable quantity) and affordances of everyday objects in the real world since the text lacks such information due to reporting bias.
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
We also find that good demonstration can save many labeled examples and consistency in demonstration contributes to better performance.
Perhaps PTLMs Should Go to School -- A Task to Assess Open Book and Closed Book QA
Our goal is to deliver a new task and leaderboard to stimulate research on question answering and pre-trained language models (PTLMs) to understand a significant instructional document, e. g., an introductory college textbook or a manual.
Improving Text Auto-Completion with Next Phrase Prediction
Language models such as GPT-2 have performed well on constructing syntactically sound sentences for text auto-completion task.
AutoTriggER: Label-Efficient and Robust Named Entity Recognition with Auxiliary Trigger Extraction
Deep neural models for named entity recognition (NER) have shown impressive results in overcoming label scarcity and generalizing to unseen entities by leveraging distant supervision and auxiliary information such as explanations.
Low Resource Named Entity Recognition
named-entity-recognition
+2
Machine-Assisted Script Curation
We describe Machine-Aided Script Curator (MASC), a system for human-machine collaborative script authoring.
RiddleSense: Reasoning about Riddle Questions Featuring Linguistic Creativity and Commonsense Knowledge
Question: I have five fingers but I am not alive.
Pre-training Text-to-Text Transformers to Write and Reason with Concepts
To augment PTLMs with common sense, we propose generative and contrastive objectives as intermediate self-supervised pre-training tasks between general pre-training and downstream task-specific fine-tuning.
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Pre-trained language models (PTLM) have achieved impressive results in a range of natural language understanding (NLU) and generation (NLG) tasks.
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data
In this work, we aim to formulate a task, construct a dataset, and provide benchmarks for developing methods for event forecasting with large volumes of unstructured text data.
TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition
In this paper, we introduce "entity triggers," an effective proxy of human explanations for facilitating label-efficient learning of NER models.
LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanation
Successfully training a deep neural network demands a huge corpus of labeled data.
AlpacaTag: An Active Learning-based Crowd Annotation Framework for Sequence Tagging
We introduce an open-source web-based data annotation framework (AlpacaTag) for sequence tagging tasks such as named-entity recognition (NER).
