Search Results for author:
Found 5 papers, 3 papers with code
RORA: Robust Free-Text Rationale Evaluation
This is achieved by assessing the conditional V-information \citep{hewitt-etal-2021-conditional} with a predictive family robust against leaky features that can be exploited by a small model.
AnaloBench: Benchmarking the Identification of Abstract and Long-context Analogies
Our benchmarking approach focuses on aspects of this ability that are common among humans: (i) recalling related experiences from a large amount of information, and (ii) applying analogical reasoning to complex and lengthy scenarios.
GEAR: Augmenting Language Models with Generalizable and Efficient Tool Resolution
GEAR achieves better efficiency by delegating tool grounding and execution to small language models (SLM) and LLM, respectively; while leveraging semantic and pattern-based evaluation at both question and answer levels for generalizable tool grounding.
ProtSi: Prototypical Siamese Network with Data Augmentation for Few-Shot Subjective Answer Evaluation
Subjective answer evaluation is a time-consuming and tedious task, and the quality of the evaluation is heavily influenced by a variety of subjective personal characteristics.
Functional Optimization Reinforcement Learning for Real-Time Bidding
In order to evaluate the proposed RTB strategy's performance, we demonstrate the results on ten sequential simulated auction campaigns.
