Search Results for author: Enrico Shippole

Found 3 papers, 3 papers with code

Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers

1 code implementation21 Jan 2024 Katherine Crowson, Stefan Andreas Baumann, Alex Birch, Tanishq Mathew Abraham, Daniel Z. Kaplan, Enrico Shippole

We present the Hourglass Diffusion Transformer (HDiT), an image generative model that exhibits linear scaling with pixel count, supporting training at high-resolution (e. g. $1024 \times 1024$) directly in pixel-space.

Image Generation

YaRN: Efficient Context Window Extension of Large Language Models

4 code implementations31 Aug 2023 Bowen Peng, Jeffrey Quesnelle, Honglu Fan, Enrico Shippole

Rotary Position Embeddings (RoPE) have been shown to effectively encode positional information in transformer-based language models.

Position

Cannot find the paper you are looking for? You can Submit a new open access paper.