Search Results for author:
Found 22 papers, 3 papers with code
One-Click Upgrade from 2D to 3D: Sandwiched RGB-D Video Compression for Stereoscopic Teleconferencing
In this paper, we propose a new approach to upgrade a 2D video codec to support stereo RGB-D video compression, by wrapping it with a neural pre- and post-processor pair.
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
While the optimization can draw photometric reference from the input videos or be regulated by generative models, directly supervising Gaussian motions remains underexplored.
Sandwiched Compression: Repurposing Standard Codecs with Neural Network Wrappers
Through a variety of examples, we apply the sandwich architecture to sources with different numbers of channels, higher resolution, higher dynamic range, and perceptual distortion measures.
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis
To improve the naturalness of the synthesized 3D hand object motions, this work proposes MACS the first MAss Conditioned 3D hand and object motion Synthesis approach.
Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
In this work, we explore egocentric whole-body motion capture using a single fisheye camera, which simultaneously estimates human body and hand motion.
Ranked #1 on
Egocentric Pose Estimation
on GlobalEgoMocap Test Dataset
(using extra training data)
Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images
We propose a novel transformer-based framework that reconstructs two high fidelity hands from multi-view RGB images.
Grad-PU: Arbitrary-Scale Point Cloud Upsampling via Gradient Descent with Learned Distance Functions
Most existing point cloud upsampling methods have roughly three steps: feature extraction, feature expansion and 3D coordinate prediction.
Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos
The learnt avatar is driven by a parametric face model to achieve user-controlled facial expressions and head poses.
Sandwiched Video Compression: Efficiently Extending the Reach of Standard Codecs with Neural Wrappers
We propose differentiable approximations to key video codec components and demonstrate that, in addition to providing meaningful compression improvements over the standard codec, the neural codes of the sandwich lead to significantly better rate-distortion performance in two important scenarios. When transporting high-resolution video via low-resolution HEVC, the sandwich system obtains 6. 5 dB improvements over standard HEVC.
Pixel-Aligned Non-parametric Hand Mesh Reconstruction
The decoder aggregate both local image features in pixels and geometric features in vertices.
PRIF: Primary Ray-based Implicit Function
We introduce a new implicit shape representation called Primary Ray-based Implicit Function (PRIF).
Density-preserving Deep Point Cloud Compression
To address this, we propose a novel deep point cloud compression method that preserves local density information.
OmniSyn: Synthesizing 360 Videos with Wide-baseline Panoramas
Immersive maps such as Google Street View and Bing Streetside provide true-to-life views with a massive collection of panoramas.
VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting
We propose VoLux-GAN, a generative framework to synthesize 3D-aware faces with convincing relighting.
Multiresolution Deep Implicit Functions for 3D Shape Representation
To the best of our knowledge, MDIF is the first deep implicit function model that can at the same time (1) represent different levels of detail and allow progressive decoding; (2) support both encoder-decoder inference and decoder-only latent optimization, and fulfill multiple applications; (3) perform detailed decoder-only shape completion.
HumanGPS: Geodesic PreServing Feature for Dense Human Correspondences
In this paper, we address the problem of building dense correspondences between human images under arbitrary camera viewpoints and body poses.
Deep Implicit Volume Compression
We describe a novel approach for compressing truncated signed distance fields (TSDF) stored in 3D voxel grids, and their corresponding textures.
Real-time Background-aware 3D Textureless Object Pose Estimation
In this work, we present a modified fuzzy decision forest for real-time 3D object pose estimation based on typical template representation.
Latent-Class Hough Forests for 6 DoF Object Pose Estimation
In this paper we present Latent-Class Hough Forests, a method for object detection and 6 DoF pose estimation in heavily cluttered and occluded scenarios.
Conditional Convolutional Neural Network for Modality-Aware Face Recognition
Faces in the wild are usually captured with various poses, illuminations and occlusions, and thus inherently multimodally distributed in many tasks.
Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose
In this paper, we show that we can significantly improving upon black box optimization by exploiting high-level knowledge of the structure of the parameters and using a local surrogate energy function.
Latent Regression Forest: Structured Estimation of 3D Articulated Hand Posture
In contrast to prior forest-based methods, which take dense pixels as input, classify them independently and then estimate joint positions afterwards; our method can be considered as a structured coarse-to-fine search, starting from the centre of mass of a point cloud until locating all the skeletal joints.
