Search Results for author:
Found 14 papers, 6 papers with code
EdgeRelight360: Text-Conditioned 360-Degree HDR Image Generation for Real-Time On-Device Video Portrait Relighting
In this paper, we present EdgeRelight360, an approach for real-time video portrait relighting on mobile devices, utilizing text-conditioned generation of 360-degree high dynamic range image (HDRI) maps.
AUEditNet: Dual-Branch Facial Action Unit Intensity Manipulation with Implicit Disentanglement
Our experiments demonstrate AUEditNet's superior accuracy in editing AU intensities, affirming its capability in disentangling facial attributes and identity within a limited subject pool.
INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields
We propose INFAMOUS-NeRF, an implicit morphable face model that introduces hypernetworks to NeRF to improve the representation power in the presence of many training subjects.
PVP: Personalized Video Prior for Editable Dynamic Portraits using StyleGAN
In this work, our goal is to take as input a monocular video of a face, and create an editable dynamic portrait able to handle extreme head poses.
GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration
In this study, we construct a registration model based on the gradient surgery mechanism, named GSMorph, to achieve a hyperparameter-free balance on multiple losses.
ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection
Then both the initial and edited embeddings are projected back (deprojected) to the initial latent space as residuals to modify the input latent vectors by subtraction and addition, representing old status removal and new status addition.
Face Relighting with Geometrically Consistent Shadows
Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose.
Perceptual Consistency in Video Segmentation
More specifically, by measuring the perceptual consistency between the predicted segmentation and the available ground truth on a nearby frame and combining it with the segmentation confidence, we can accurately assess the classification correctness on each pixel.
Towards High Fidelity Face Relighting with Realistic Shadows
Furthermore, we introduce a method to use the shadow mask to estimate the ambient light intensity in an image, and are thus able to leverage multiple datasets during training with different global lighting intensities.
Real-Time Selfie Video Stabilization
Our method is fully automatic and produces visually and quantitatively better results than previous real-time general video stabilization methods.
Weakly-Supervised Degree of Eye-Closeness Estimation
To alleviate this issue, we propose a weakly-supervised method which utilizes the accurate annotation from the synthetic data set, to learn accurate degree of eye openness, and the weakly labeled (open or closed) real world eye data set to control the domain shift.
PPGNet: Learning Point-Pair Graph for Line Segment Detection
In this paper, we present a novel framework to detect line segments in man-made environments.
Generic Multiview Visual Tracking
A natural solution to these challenges is to use multiple cameras with multiview inputs, though existing systems are mostly limited to specific targets (e. g. human), static cameras, and/or camera calibration.
DAC: Data-free Automatic Acceleration of Convolutional Networks
A complex deep learning model with high accuracy runs slowly on resource-limited devices, while a light-weight model that runs much faster loses accuracy.
