Search Results for author:
Found 3 papers, 1 papers with code
Extending Context Window of Large Language Models via Positional Interpolation
We present Position Interpolation (PI) that extends the context window sizes of RoPE-based pretrained LLMs such as LLaMA models to up to 32768 with minimal fine-tuning (within 1000 steps), while demonstrating strong empirical results on various tasks that require long context, including passkey retrieval, language modeling, and long document summarization from LLaMA 7B to 65B.
Combinatorial Pure Exploration of Multi-Armed Bandits
We also establish a general problem-dependent lower bound for the CPE problem.
Exact and Stable Recovery of Pairwise Interaction Tensors
For the noisy cases, we also prove error bounds for a constrained convex program for recovering the tensors.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
