Search Results for author: Jaakko Lehtinen

Found 23 papers, 20 papers with code

Analyzing and Improving the Training Dynamics of Diffusion Models

4 code implementations5 Dec 2023 Tero Karras, Miika Aittala, Jaakko Lehtinen, Janne Hellsten, Timo Aila, Samuli Laine

Diffusion models currently dominate the field of data-driven image synthesis with their unparalleled scaling to large datasets.

Image Generation Philosophy

Simulator-Based Self-Supervision for Learned 3D Tomography Reconstruction

no code implementations14 Dec 2022 Onni Kosomaa, Samuli Laine, Tero Karras, Miika Aittala, Jaakko Lehtinen

We propose a deep learning method for 3D volumetric reconstruction in low-dose helical cone-beam computed tomography.

3D Volumetric Reconstruction

Solving Audio Inverse Problems with a Diffusion Model

1 code implementation27 Oct 2022 Eloi Moliner, Jaakko Lehtinen, Vesa Välimäki

This paper presents CQT-Diff, a data-driven generative audio model that can, once trained, be used for solving various different audio inverse problems in a problem-agnostic setting.

Audio inpainting Bandwidth Extension

Disentangling Random and Cyclic Effects in Time-Lapse Sequences

1 code implementation4 Jul 2022 Erik Härkönen, Miika Aittala, Tuomas Kynkäänniemi, Samuli Laine, Timo Aila, Jaakko Lehtinen

We introduce the problem of disentangling time-lapse sequences in a way that allows separate, after-the-fact control of overall trends, cyclic effects, and random effects in the images, and describe a technique based on data-driven generative models that achieves this goal.

Generating Long Videos of Dynamic Scenes

1 code implementation7 Jun 2022 Tim Brooks, Janne Hellsten, Miika Aittala, Ting-Chun Wang, Timo Aila, Jaakko Lehtinen, Ming-Yu Liu, Alexei A. Efros, Tero Karras

Existing video generation methods often fail to produce new content as a function of time while maintaining consistencies expected in real environments, such as plausible dynamics and object persistence.

MORPH Video Generation

The Role of ImageNet Classes in Fréchet Inception Distance

1 code implementation11 Mar 2022 Tuomas Kynkäänniemi, Tero Karras, Miika Aittala, Timo Aila, Jaakko Lehtinen

Fr\'echet Inception Distance (FID) is the primary metric for ranking models in data-driven generative modeling.

Alias-Free Generative Adversarial Networks

7 code implementations NeurIPS 2021 Tero Karras, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko Lehtinen, Timo Aila

We observe that despite their hierarchical convolutional nature, the synthesis process of typical generative adversarial networks depends on absolute pixel coordinates in an unhealthy manner.

Image Generation

Modular Primitives for High-Performance Differentiable Rendering

1 code implementation6 Nov 2020 Samuli Laine, Janne Hellsten, Tero Karras, Yeongho Seol, Jaakko Lehtinen, Timo Aila

We present a modular differentiable renderer design that yields performance superior to previous methods by leveraging existing, highly optimized hardware graphics pipelines.

Attribute Inverse Rendering +1

GANSpace: Discovering Interpretable GAN Controls

2 code implementations NeurIPS 2020 Erik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain Paris

This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis, such as change of viewpoint, aging, lighting, and time of day.

Image Generation

Analyzing and Improving the Image Quality of StyleGAN

121 code implementations CVPR 2020 Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, Timo Aila

Overall, our improved model redefines the state of the art in unconditional image modeling, both in terms of existing distribution quality metrics as well as perceived image quality.

Attribute Conditional Image Generation

Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer

1 code implementation NeurIPS 2019 Wenzheng Chen, Jun Gao, Huan Ling, Edward J. Smith, Jaakko Lehtinen, Alec Jacobson, Sanja Fidler

Many machine learning models operate on images, but ignore the fact that images are 2D projections formed by 3D geometry interacting with light, in a process called rendering.

Single-View 3D Reconstruction

E-LPIPS: Robust Perceptual Image Similarity via Random Transformation Ensembles

1 code implementation10 Jun 2019 Markus Kettunen, Erik Härkönen, Jaakko Lehtinen

It has been recently shown that the hidden variables of convolutional neural networks make for an efficient perceptual similarity metric that accurately predicts human judgment on relative image similarity assessment.

Image Similarity Search

Few-Shot Unsupervised Image-to-Image Translation

10 code implementations ICCV 2019 Ming-Yu Liu, Xun Huang, Arun Mallya, Tero Karras, Timo Aila, Jaakko Lehtinen, Jan Kautz

Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images.

Translation Unsupervised Image-To-Image Translation

Improved Precision and Recall Metric for Assessing Generative Models

9 code implementations NeurIPS 2019 Tuomas Kynkäänniemi, Tero Karras, Samuli Laine, Jaakko Lehtinen, Timo Aila

The ability to automatically estimate the quality and coverage of the samples produced by a generative model is a vital requirement for driving algorithm research.

Image Generation

Improved Self-Supervised Deep Image Denoising

no code implementations ICLR Workshop LLD 2019 Samuli Laine, Jaakko Lehtinen, Timo Aila

We describe techniques for training high-quality image denoising models that require only single instances of corrupted images as training data.

Image Denoising

High-Quality Self-Supervised Deep Image Denoising

2 code implementations NeurIPS 2019 Samuli Laine, Tero Karras, Jaakko Lehtinen, Timo Aila

We describe a novel method for training high-quality image denoising models based on unorganized collections of corrupted images.

Image Denoising Vocal Bursts Intensity Prediction

Differentiable Monte Carlo Ray Tracing through Edge Sampling

1 code implementation SIGGRAPH 2018 Tzu-Mao Li, Miika Aittala, Frédo Durand, Jaakko Lehtinen

We introduce a general-purpose differentiable ray tracer, which, to our knowledge, is the first comprehensive solution that is able to compute derivatives of scalar functions over a rendered image with respect to arbitrary scene parameters such as camera pose, scene geometry, materials, and lighting parameters.

Inverse Rendering

Noise2Noise: Learning Image Restoration without Clean Data

21 code implementations ICML 2018 Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, Timo Aila

We apply basic statistical reasoning to signal reconstruction by machine learning -- learning to map corrupted observations to clean signals -- with a simple and powerful conclusion: it is possible to learn to restore images by only looking at corrupted examples, at performance at and sometimes exceeding training using clean data, without explicit image priors or likelihood models of the corruption.

BIG-bench Machine Learning Image Restoration +1

Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion

no code implementations SIGGRAPH 2017 Tero Karras, Timo Aila, Samuli Laine, Antti Herva, Jaakko Lehtinen

Our deep neural network learns a mapping from input waveforms to the 3D vertex coordinates of a face model, and simultaneously discovers a compact, latent code that disambiguates the variations in facial expression that cannot be explained by the audio alone.

Face Model

Production-Level Facial Performance Capture Using Deep Convolutional Neural Networks

1 code implementation21 Sep 2016 Samuli Laine, Tero Karras, Timo Aila, Antti Herva, Shunsuke Saito, Ronald Yu, Hao Li, Jaakko Lehtinen

We present a real-time deep learning framework for video-based facial performance capture -- the dense 3D tracking of an actor's face given a monocular video.

Cannot find the paper you are looking for? You can Submit a new open access paper.