Search Results for author:
Found 14 papers, 6 papers with code
A Conversational Paradigm for Program Synthesis
We train a family of large language models, called CodeGen, on natural language and programming language data.
Ranked #1 on
Program Synthesis
on HumanEval
Learning Energy-Based Approximate Inference Networks for Structured Applications in NLP
In this dissertation, we discuss the concept of the energy function and structured models with different energy functions.
An Exploration of Arbitrary-Order Sequence Labeling via Energy-Based Inference Networks
Many tasks in natural language processing involve predicting structured outputs, e. g., sequence labeling, semantic role labeling, parsing, and machine translation.
An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models
Recent work has shown that pre-trained language models such as BERT improve robustness to spurious correlations in the dataset.
ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation
We propose to train a non-autoregressive machine translation model to minimize the energy defined by a pretrained autoregressive model.
Improving Joint Training of Inference Networks and Structured Prediction Energy Networks
Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016).
Generating Diverse Story Continuations with Controllable Semantics
We propose a simple and effective modeling framework for controlled generation of multiple, diverse outputs.
Benchmarking Approximate Inference Methods for Neural Structured Prediction
One approach is to perform gradient descent with respect to the output structure directly (Belanger and McCallum, 2016).
Quality Signals in Generated Stories
We study the problem of measuring the quality of automatically-generated stories.
Learning Approximate Inference Networks for Structured Prediction
Prior work used gradient descent for inference, relaxing the structured output to a set of continuous variables and then optimizing the energy with respect to them.
Pay Attention to the Ending:Strong Neural Baselines for the ROC Story Cloze Task
We consider the ROC story cloze task (Mostafazadeh et al., 2016) and present several findings.
Learning to Embed Words in Context for Syntactic Tasks
We present models for embedding words in the context of surrounding words.
Network Inference by Learned Node-Specific Degree Prior
We propose a novel method for network inference from partially observed edges using a node-specific degree prior.
