INFAMOUS-NeRF: ImproviNg FAce MOdeling Using Semantically-Aligned Hypernetworks with Neural Radiance Fields

no code implementations • 23 Dec 2023 • Andrew Hou, Feng Liu, Zhiyuan Ren, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu

We propose INFAMOUS-NeRF, an implicit morphable face model that introduces hypernetworks to NeRF to improve the representation power in the presence of many training subjects.

Face Model

Face Relighting with Geometrically Consistent Shadows

1 code implementation • CVPR 2022 • Andrew Hou, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu

Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose.

Towards High Fidelity Face Relighting with Realistic Shadows

1 code implementation • CVPR 2021 • Andrew Hou, Ze Zhang, Michel Sarkis, Ning Bi, Yiying Tong, Xiaoming Liu

Furthermore, we introduce a method to use the shadow mask to estimate the ambient light intensity in an image, and are thus able to leverage multiple datasets during training with different global lighting intensities.

Vocal Bursts Intensity Prediction