Search Results for author: Jeffrey Quesnelle

Found 1 papers, 1 papers with code

YaRN: Efficient Context Window Extension of Large Language Models

4 code implementations31 Aug 2023 Bowen Peng, Jeffrey Quesnelle, Honglu Fan, Enrico Shippole

Rotary Position Embeddings (RoPE) have been shown to effectively encode positional information in transformer-based language models.

Position

Cannot find the paper you are looking for? You can Submit a new open access paper.