Search Results for author:
Found 6 papers, 2 papers with code
MambaByte: Token-free Selective State Space Model
We propose MambaByte, a token-free adaptation of the Mamba SSM trained autoregressively on byte sequences.
Diffusion Models Without Attention
In recent advancements in high-fidelity image generation, Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a key player.
On What Basis? Predicting Text Preference Via Structured Comparative Reasoning
Comparative reasoning plays a crucial role in text preference prediction; however, large language models (LLMs) often demonstrate inconsistencies in their reasoning.
Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning
To fully unleash the power of explanations, we propose EASE, an Explanation-Aware Soft Ensemble framework to empower in-context learning with LLMs.
TimelineQA: A Benchmark for Question Answering over Timelines
We describe a set of experiments on TimelineQA with several state-of-the-art QA models.
Pretraining Without Attention
Even so, BiGS is able to match BERT pretraining accuracy on GLUE and can be extended to long-form pretraining of 4096 tokens without approximation.
