Search Results for author: Jifei Song

Found 15 papers, 3 papers with code

NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction

no code implementations8 Feb 2024 Zhongqun Zhang, Jifei Song, Eduardo Pérez-Pellitero, Yiren Zhou, Hyung Jin Chang, Aleš Leonardis

Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction photo-realistically, suffering from degraded rendering quality caused by the heavy mutual occlusions between the hand and the object, and inaccurate hand-object pose estimation.

hand-object pose Novel View Synthesis +3

Deformable 3D Gaussian Splatting for Animatable Human Avatars

no code implementations22 Dec 2023 HyunJun Jung, Nikolas Brasch, Jifei Song, Eduardo Perez-Pellitero, Yiren Zhou, Zhihao LI, Nassir Navab, Benjamin Busam

ParDy-Human introduces parameter-driven dynamics into 3D Gaussian Splatting where 3D Gaussians are deformed by a human pose model to animate the avatar.

Novel View Synthesis

SWAGS: Sampling Windows Adaptively for Dynamic 3D Gaussian Splatting

no code implementations20 Dec 2023 Richard Shaw, Jifei Song, Arthur Moreau, Michal Nazarczuk, Sibi Catley-Chandar, Helisa Dhamo, Eduardo Perez-Pellitero

We model the dynamics of a scene using a tunable MLP, which learns the deformation field from a canonical space to a set of 3D Gaussians per frame.

Novel View Synthesis

Reality's Canvas, Language's Brush: Crafting 3D Avatars from Monocular Video

no code implementations8 Dec 2023 Yuchen Rao, Eduardo Perez Pellitero, Benjamin Busam, Yiren Zhou, Jifei Song

A pose-conditioned deformable NeRF is optimized to volumetrically represent a human subject in canonical T-pose.

Image Generation

HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting

no code implementations5 Dec 2023 Helisa Dhamo, Yinyu Nie, Arthur Moreau, Jifei Song, Richard Shaw, Yiren Zhou, Eduardo Pérez-Pellitero

3D head animation has seen major quality and runtime improvements over the last few years, particularly empowered by the advances in differentiable rendering and neural radiance fields.

Human Gaussian Splatting: Real-time Rendering of Animatable Avatars

1 code implementation28 Nov 2023 Arthur Moreau, Jifei Song, Helisa Dhamo, Richard Shaw, Yiren Zhou, Eduardo Pérez-Pellitero

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos.

CroMo: Cross-Modal Learning for Monocular Depth Estimation

no code implementations CVPR 2022 Yannick Verdié, Jifei Song, Barnabé Mas, Benjamin Busam, Aleš Leonardis, Steven McDonagh

Learning-based depth estimation has witnessed recent progress in multiple directions; from self-supervision using monocular video to supervised methods offering highest accuracy.

Monocular Depth Estimation

Deep Factorised Inverse-Sketching

no code implementations ECCV 2018 Kaiyue Pang, Da Li, Jifei Song, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales

Instead there is a fundamental process of abstraction and iconic rendering, where overall geometry is warped and salient details are selectively included.

Retrieval Sketch-Based Image Retrieval +1

Learning to Sketch with Shortcut Cycle Consistency

no code implementations CVPR 2018 Jifei Song, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Timothy Hospedales

In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process.

Multi-Task Learning Retrieval +1

Cannot find the paper you are looking for? You can Submit a new open access paper.