Search Results for author: Sergey Prokudin

Found 9 papers, 5 papers with code

Creating a Digital Twin of Spinal Surgery: A Proof of Concept

no code implementations25 Mar 2024 Jonas Hein, Frederic Giraud, Lilian Calvet, Alexander Schwarz, Nicola Alessandro Cavalcanti, Sergey Prokudin, Mazda Farshad, Siyu Tang, Marc Pollefeys, Fabio Carrillo, Philipp Fürnstahl

In this paper, we present a proof of concept (PoC) for surgery digitalization that is applied to an ex-vivo spinal surgery performed in realistic conditions.

3D Reconstruction Anatomy

Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation

no code implementations9 Jan 2024 Xiyi Chen, Marko Mihajlovic, Shaofei Wang, Sergey Prokudin, Siyu Tang

To the best of our knowledge, our proposed framework is the first diffusion model to enable the creation of fully 3D-consistent, animatable, and photorealistic human avatars from a single image of an unseen subject; extensive quantitative and qualitative evaluations demonstrate the advantages of our approach over existing state-of-the-art avatar creation models on both novel view and novel expression synthesis tasks.

Novel View Synthesis

ResFields: Residual Neural Fields for Spatiotemporal Signals

1 code implementation6 Sep 2023 Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang

Neural fields, a category of neural networks trained to represent high-frequency signals, have gained significant attention in recent years due to their impressive performance in modeling complex 3D data, such as signed distance (SDFs) or radiance fields (NeRFs), via a single multi-layer perceptron (MLP).

4D reconstruction Neural Rendering

Dynamic Point Fields

no code implementations ICCV 2023 Sergey Prokudin, Qianli Ma, Maxime Raafat, Julien Valentin, Siyu Tang

In this work, we present a dynamic point field model that combines the representational benefits of explicit point-based graphics with implicit deformation networks to allow efficient modeling of non-rigid 3D surfaces.

Surface Reconstruction

HARP: Personalized Hand Reconstruction from a Monocular RGB Video

no code implementations CVPR 2023 Korrawe Karunratanakul, Sergey Prokudin, Otmar Hilliges, Siyu Tang

We present HARP (HAnd Reconstruction and Personalization), a personalized hand avatar creation approach that takes a short monocular RGB video of a human hand as input and reconstructs a faithful hand avatar exhibiting a high-fidelity appearance and geometry.

3D Hand Pose Estimation

SMPLpix: Neural Avatars from 3D Human Models

1 code implementation16 Aug 2020 Sergey Prokudin, Michael J. Black, Javier Romero

Recent advances in deep generative models have led to an unprecedented level of realism for synthetically generated images of humans.

Real Time Trajectory Prediction Using Deep Conditional Generative Models

1 code implementation9 Sep 2019 Sebastian Gomez-Gonzalez, Sergey Prokudin, Bernhard Scholkopf, Jan Peters

Our method uses encoder and decoder deep networks that maps complete or partial trajectories to a Gaussian distributed latent space and back, allowing for fast inference of the future values of a trajectory given previous observations.

Time Series Time Series Forecasting +1

Efficient Learning on Point Clouds with Basis Point Sets

1 code implementation ICCV 2019 Sergey Prokudin, Christoph Lassner, Javier Romero

The basis point set representation is a residual representation that can be computed efficiently and can be used with standard neural network architectures and other machine learning algorithms.

BIG-bench Machine Learning

Deep Directional Statistics: Pose Estimation with Uncertainty Quantification

1 code implementation ECCV 2018 Sergey Prokudin, Peter Gehler, Sebastian Nowozin

However, in challenging imaging conditions such as on low-resolution images or when the image is corrupted by imaging artifacts, current systems degrade considerably in accuracy.

Pose Estimation Probabilistic Deep Learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.