Search Results for author:
Found 12 papers, 4 papers with code
Explorative Inbetweening of Time and Space
We introduce bounded generation as a generalized task to control video generation to synthesize arbitrary camera and subject motion based only on a given start and end frame.
Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos
We show that by using simple segmentations and coarse 2D manipulations, we can synthesize a photorealistic edit faithful to the user's input while addressing second-order effects like harmonizing the lighting and physical interactions between edited objects.
Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image
At the core of portrait photography is the search for ideal lighting and viewpoint.
Restoration by Generation with Constrained Priors
We propose a method to adapt a pretrained diffusion model for image restoration by simply adding noise to the input image to be restored and then denoise.
DiffusionRig: Learning Personalized Priors for Facial Appearance Editing
On a high level, DiffusionRig learns to map simplistic renderings of 3D face models to realistic photos of a given person.
Automatic High Resolution Wire Segmentation and Removal
In this paper, we present an automatic wire clean-up system that eases the process of wire segmentation and removal/inpainting to within a few seconds.
LightPainter: Interactive Portrait Relighting with Freehand Scribble
Recent portrait relighting methods have achieved realistic results of portrait lighting effects given a desired lighting representation such as an environment map.
SunStage: Portrait Reconstruction and Relighting using the Sun as a Light Stage
Our method only requires the user to capture a selfie video outdoors, rotating in place, and uses the varying angles between the sun and the face as guidance in joint reconstruction of facial geometry, reflectance, camera pose, and lighting parameters.
Time-Travel Rephotography
Many historical people were only ever captured by old, faded, black and white photos, that are distorted due to the limitations of early cameras and the passage of time.
Zoom to Learn, Learn to Zoom
We show how to obtain such ground-truth data via optical zoom and contribute a dataset, SR-RAW, for real-world computational zoom.
Synthetic Defocus and Look-Ahead Autofocus for Casual Videography
We present a system that synthetically renders refocusable video from a deep DOF video shot with a smartphone, and analyzes future video frames to deliver context-aware autofocus for the current frame.
Single Image Reflection Separation with Perceptual Losses
Our loss function includes two perceptual losses: a feature loss from a visual perception network, and an adversarial loss that encodes characteristics of images in the transmission layers.
