Search Results for author:
Found 13 papers, 11 papers with code
Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators
Scaling test-time computation, or affording a generator large language model (LLM) extra compute during inference, typically employs the help of external non-generative evaluators (i. e., reward models).
ReIFE: Re-evaluating Instruction-Following Evaluation
The automatic evaluation of instruction following typically involves using large language models (LLMs) to assess response quality.
Direct Judgement Preference Optimization
Auto-evaluation is crucial for assessing response quality and offering feedback for model development.
SCOTT: Self-Consistent Chain-of-Thought Distillation
While CoT can yield dramatically improved performance, such gains are only observed for sufficiently large LMs.
PINTO: Faithful Language Reasoning Using Prompt-Generated Rationales
Neural language models (LMs) have achieved impressive results on various language-based reasoning tasks by utilizing latent knowledge encoded in their own pretrained parameters.
Contextualized Scene Imagination for Generative Commonsense Reasoning
In this paper, we propose an Imagine-and-Verbalize (I&V) method, which learns to imagine a relational scene knowledge graph (SKG) with relations between the input concepts, and leverage the SKG as a constraint when generating a plausible scene description.
Do Language Models Perform Generalizable Commonsense Inference?
Inspired by evidence that pretrained language models (LMs) encode commonsense knowledge, recent work has applied LMs to automatically populate commonsense knowledge graphs (CKGs).
Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation
Knowledge graphs (KGs) have helped neural models improve performance on various knowledge-intensive tasks, like question answering and item recommendation.
When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models
We also demonstrate that distributional methods are ideal to make up for pattern-based ones in such cases.
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering
In this paper, we augment a general commonsense QA framework with a knowledgeable path generator.
Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering
Existing work on augmenting question answering (QA) models with external knowledge (e. g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale.
Logic Attention Based Neighborhood Aggregation for Inductive Knowledge Graph Embedding
Recent efforts on this issue suggest training a neighborhood aggregator in conjunction with the conventional entity and relation embeddings, which may help embed new entities inductively via their existing neighbors.
Incorporating GAN for Negative Sampling in Knowledge Representation Learning
In this GAN-based framework, we take advantage of a generator to obtain high-quality negative samples.
