MobileNVC: Real-time 1080p Neural Video Compression on a Mobile Device

no code implementations • 2 Oct 2023 • Ties van Rozendaal, Tushar Singhal, Hoang Le, Guillaume Sautiere, Amir Said, Krishna Buska, Anjuman Raha, Dimitris Kalatzis, Hitarth Mehta, Frank Mayer, Liang Zhang, Markus Nagel, Auke Wiggers

This work presents the first neural video codec that decodes 1080p YUV420 video in real time on a mobile device.

Motion Compensation Quantization +1

Instance-Adaptive Video Compression: Improving Neural Codecs by Training on the Test Set

no code implementations • 19 Nov 2021 • Ties van Rozendaal, Johann Brehmer, Yunfan Zhang, Reza Pourreza, Auke Wiggers, Taco S. Cohen

We introduce a video compression algorithm based on instance-adaptive learning.

Video Compression

Overfitting for Fun and Profit: Instance-Adaptive Data Compression

no code implementations • ICLR 2021 • Ties van Rozendaal, Iris A. M. Huijben, Taco S. Cohen

At a high level, neural compression is based on an autoencoder that tries to reconstruct the input instance from a (quantized) latent representation, coupled with a prior that is used to losslessly compress these latents.

Data Compression Image Compression +1

Lossy Compression with Distortion Constrained Optimization

no code implementations • 8 May 2020 • Ties van Rozendaal, Guillaume Sautière, Taco S. Cohen

We argue that the constrained optimization method of Rezende and Viola, 2018 is a lot more appropriate for training lossy compression models because it allows us to obtain the best possible rate subject to a distortion constraint.

Image Compression Model Selection

Video Compression With Rate-Distortion Autoencoders

no code implementations • ICCV 2019 • Amirhossein Habibian, Ties van Rozendaal, Jakub M. Tomczak, Taco S. Cohen

We employ a model that consists of a 3D autoencoder with a discrete latent space and an autoregressive prior used for entropy coding.

Motion Compensation Video Compression