Search Results for author: Florian Bernard

Found 54 papers, 13 papers with code

i3DMM: Deep Implicit 3D Morphable Model of Human Heads

1 code implementation CVPR 2021 Tarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel, Mohamed Elgharib, Daniel Cremers, Christian Theobalt

Our approach has the following favorable properties: (i) It is the first full head morphable model that includes hair.

A Unified Framework for Implicit Sinkhorn Differentiation

1 code implementation CVPR 2022 Marvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Florian Bernard, Daniel Cremers

The Sinkhorn operator has recently experienced a surge of popularity in computer vision and related fields.

Fast Discrete Optimisation for Geometrically Consistent 3D Shape Matching

1 code implementation12 Oct 2023 Paul Roetzer, Ahmed Abbas, Dongliang Cao, Florian Bernard, Paul Swoboda

In this work we propose to combine the advantages of learning-based and combinatorial formalisms for 3D shape matching.

valid

Unsupervised Learning of Robust Spectral Shape Matching

1 code implementation27 Apr 2023 Dongliang Cao, Paul Roetzer, Florian Bernard

In contrast, building upon recent insights about the relation between functional maps and point-wise maps, we propose a novel unsupervised loss to couple the functional maps and point-wise maps, and thereby directly obtain point-wise maps without any post-processing.

Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matching

1 code implementation CVPR 2023 Dongliang Cao, Florian Bernard

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds.

Self-Supervised Learning

Unsupervised Deep Multi-Shape Matching

1 code implementation20 Jul 2022 Dongliang Cao, Florian Bernard

In this paper, we present a novel approach for deep multi-shape matching that ensures cycle-consistent multi-matchings while not depending on an explicit template shape.

Shape-aware Surface Reconstruction from Sparse 3D Point-Clouds

1 code implementation26 Feb 2016 Florian Bernard, Luis Salamanca, Johan Thunberg, Alexander Tack, Dennis Jentsch, Hans Lamecker, Stefan Zachow, Frank Hertel, Jorge Goncalves, Peter Gemmar

Estimating the parameters of the GMM in a maximum a posteriori manner yields the reconstruction of the surface from the given data points.

Anatomy Surface Reconstruction

A Scalable Combinatorial Solver for Elastic Geometrically Consistent 3D Shape Matching

1 code implementation CVPR 2022 Paul Roetzer, Paul Swoboda, Daniel Cremers, Florian Bernard

We present a scalable combinatorial algorithm for globally optimizing over the space of geometrically consistent mappings between 3D shapes.

Conjugate Product Graphs for Globally Optimal 2D-3D Shape Matching

1 code implementation CVPR 2023 Paul Roetzer, Zorah Lähner, Florian Bernard

We consider the problem of finding a continuous and non-rigid matching between a 2D contour and a 3D mesh.

Shortest Paths in Graphs with Matrix-Valued Edges: Concepts, Algorithm and Application to 3D Multi-Shape Analysis

1 code implementation8 Dec 2021 Viktoria Ehm, Daniel Cremers, Florian Bernard

Traditionally, the concept of a shortest path is considered for graphs with scalar edge weights, which makes it possible to compute the length of a path by adding up the individual edge weights.

Image Segmentation Semantic Segmentation

Efficient and Flexible Sublabel-Accurate Energy Minimization

1 code implementation20 Jun 2022 Zhakshylyk Nurlanov, Daniel Cremers, Florian Bernard

While discrete optimization methods are able to give theoretical optimality guarantees, they can only handle a finite number of labels and therefore suffer from label discretization bias.

Image Denoising

Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz

no code implementations CVPR 2018 Ayush Tewari, Michael Zollhöfer, Pablo Garrido, Florian Bernard, Hyeongwoo Kim, Patrick Pérez, Christian Theobalt

To alleviate this problem, we present the first approach that jointly learns 1) a regressor for face shape, expression, reflectance and illumination on the basis of 2) a concurrently learned parametric face model.

Face Model Monocular Reconstruction

Synchronisation of Partial Multi-Matchings via Non-negative Factorisations

no code implementations16 Mar 2018 Florian Bernard, Johan Thunberg, Jorge Goncalves, Christian Theobalt

In order to deal with the inherent non-convexity of the permutation synchronisation problem, we use an initialisation procedure based on a novel rotation scheme applied to the solution of the spectral relaxation.

Clustering

MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction

no code implementations ICCV 2017 Ayush Tewari, Michael Zollhöfer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick Pérez, Christian Theobalt

In this work we propose a novel model-based deep convolutional autoencoder that addresses the highly challenging problem of reconstructing a 3D human face from a single in-the-wild color image.

Face Reconstruction Monocular Reconstruction

Linear Shape Deformation Models with Local Support Using Graph-based Structured Matrix Factorisation

no code implementations CVPR 2016 Florian Bernard, Peter Gemmar, Frank Hertel, Jorge Goncalves, Johan Thunberg

Representing 3D shape deformations by linear models in high-dimensional space has many applications in computer vision and medical imaging, such as shape-based interpolation or segmentation.

On Transitive Consistency for Linear Invertible Transformations between Euclidean Coordinate Systems

no code implementations2 Sep 2015 Johan Thunberg, Florian Bernard, Jorge Goncalves

Two direct or centralized synchronization methods are presented for different graph topologies; the first one for quasi-strongly connected graphs, and the second one for connected graphs.

A Solution for Multi-Alignment by Transformation Synchronisation

no code implementations CVPR 2015 Florian Bernard, Johan Thunberg, Peter Gemmar, Frank Hertel, Andreas Husch, Jorge Goncalves

Simulations demonstrate that for noisy transformations, a large proportion of missing data and even for wrong correspondence assignments the method delivers encouraging results.

Neural Rendering and Reenactment of Human Actor Videos

no code implementations11 Sep 2018 Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Hyeongwoo Kim, Florian Bernard, Marc Habermann, Wenping Wang, Christian Theobalt

In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of the human, but instead rely on a video sequence in conjunction with a (medium-quality) controllable 3D template model of the person.

Generative Adversarial Network Image Generation +1

Higher-order Projected Power Iterations for Scalable Multi-Matching

no code implementations26 Nov 2018 Florian Bernard, Johan Thunberg, Paul Swoboda, Christian Theobalt

The matching of multiple objects (e. g. shapes or images) is a fundamental problem in vision and graphics.

FML: Face Model Learning from Videos

no code implementations CVPR 2019 Ayush Tewari, Florian Bernard, Pablo Garrido, Gaurav Bharaj, Mohamed Elgharib, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

In contrast, we propose multi-frame video-based self-supervised training of a deep network that (i) learns a face identity model both in shape and appearance while (ii) jointly learning to reconstruct 3D faces.

3D Reconstruction Face Model

Convex Optimisation for Inverse Kinematics

no code implementations24 Oct 2019 Tarun Yenamandra, Florian Bernard, Jiayi Wang, Franziska Mueller, Christian Theobalt

We consider the problem of inverse kinematics (IK), where one wants to find the parameters of a given kinematic skeleton that best explain a set of observed 3D joint locations.

Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation

no code implementations14 Jan 2020 Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhoefer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt

In this paper, we propose a novel human video synthesis method that approaches these limiting factors by explicitly disentangling the learning of time-coherent fine-scale details from the embedding of the human in 2D screen space.

Image-to-Image Translation Novel View Synthesis +1

StyleRig: Rigging StyleGAN for 3D Control over Portrait Images

no code implementations CVPR 2020 Ayush Tewari, Mohamed Elgharib, Gaurav Bharaj, Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

StyleGAN generates photorealistic portrait images of faces with eyes, teeth, hair and context (neck, shoulders, background), but lacks a rig-like control over semantic face parameters that are interpretable in 3D, such as face pose, expressions, and scene illumination.

HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalization

no code implementations ECCV 2020 Neng Qian, Jiayi Wang, Franziska Mueller, Florian Bernard, Vladislav Golyanik, Christian Theobalt

3D hand reconstruction from images is a widely-studied problem in computer vision and graphics, and has a particularly high relevance for virtual and augmented reality.

Neural Rendering

PIE: Portrait Image Embedding for Semantic Control

no code implementations20 Sep 2020 Ayush Tewari, Mohamed Elgharib, Mallikarjun B R., Florian Bernard, Hans-Peter Seidel, Patrick Pérez, Michael Zollhöfer, Christian Theobalt

We present the first approach for embedding real portrait images in the latent space of StyleGAN, which allows for intuitive editing of the head pose, facial expression, and scene illumination in the image.

Face Model

Isometric Multi-Shape Matching

no code implementations CVPR 2021 Maolin Gao, Zorah Lähner, Johan Thunberg, Daniel Cremers, Florian Bernard

Finding correspondences between shapes is a fundamental problem in computer vision and graphics, which is relevant for many applications, including 3D reconstruction, object tracking, and style transfer.

3D Reconstruction Object Tracking +1

Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections

no code implementations31 Mar 2021 Zhenzhang Ye, Tarun Yenamandra, Florian Bernard, Daniel Cremers

While these approaches mainly focus on learning node and edge attributes, they completely ignore the 3D geometry of the underlying 3D objects depicted in the 2D images.

Graph Matching

RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video

no code implementations22 Jun 2021 Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, Christian Theobalt

Moreover, we demonstrate that our approach offers previously unseen two-hand tracking performance from RGB, and quantitatively and qualitatively outperforms existing RGB-based methods that were not explicitly designed for two-hand interactions.

3D Reconstruction Sign Language Recognition

Sparse Quadratic Optimisation over the Stiefel Manifold with Application to Permutation Synchronisation

no code implementations NeurIPS 2021 Florian Bernard, Daniel Cremers, Johan Thunberg

We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function.

Constrained Clustering Graph Matching

Scalable Sinkhorn Backpropagation

no code implementations29 Sep 2021 Marvin Eisenberger, Aysim Toker, Laura Leal-Taixé, Florian Bernard, Daniel Cremers

Our main contribution is deriving a simple and efficient algorithm that performs this backward pass in closed form.

Rolling Shutter Correction

Structured Prediction Problem Archive

no code implementations4 Feb 2022 Paul Swoboda, Bjoern Andres, Andrea Hornakova, Florian Bernard, Jannik Irmai, Paul Roetzer, Bogdan Savchynskyy, David Stein, Ahmed Abbas

In order to facilitate algorithm development for their numerical solution, we collect in one place a large number of datasets in easy to read formats for a diverse set of problem classes.

Benchmarking Structured Prediction

The Probabilistic Normal Epipolar Constraint for Frame-To-Frame Rotation Optimization under Uncertain Feature Positions

no code implementations CVPR 2022 Dominik Muhle, Lukas Koestler, Nikolaus Demmel, Florian Bernard, Daniel Cremers

However, their approach does not take into account uncertainties, so that the accuracy of the estimated relative pose is highly dependent on accurate feature positions in the target frame.

Neural Implicit Representations for Physical Parameter Inference from a Single Video

no code implementations29 Apr 2022 Florian Hofherr, Lukas Koestler, Florian Bernard, Daniel Cremers

Neural networks have recently been used to analyze diverse physical systems and to identify the underlying dynamics.

HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow

no code implementations4 Oct 2022 Jiayi Wang, Diogo Luvizon, Franziska Mueller, Florian Bernard, Adam Kortylewski, Dan Casas, Christian Theobalt

Through this, we demonstrate the quality of our probabilistic reconstruction and show that explicit ambiguity modeling is better-suited for this challenging problem.

valid

Adaptive Certified Training: Towards Better Accuracy-Robustness Tradeoffs

no code implementations24 Jul 2023 Zhakshylyk Nurlanov, Frank R. Schmidt, Florian Bernard

Existing certified training methods produce models that achieve high provable robustness guarantees at certain perturbation levels.

SIGMA: Scale-Invariant Global Sparse Shape Matching

no code implementations ICCV 2023 Maolin Gao, Paul Roetzer, Marvin Eisenberger, Zorah Lähner, Michael Moeller, Daniel Cremers, Florian Bernard

We propose a novel mixed-integer programming (MIP) formulation for generating precise sparse correspondences for highly non-rigid shapes.

Geometrically Consistent Partial Shape Matching

no code implementations10 Sep 2023 Viktoria Ehm, Paul Roetzer, Marvin Eisenberger, Maolin Gao, Florian Bernard, Daniel Cremers

Moreover, while in practice one often has only access to partial observations of a 3D shape (e. g. due to occlusion, or scanning artifacts), there do not exist any methods that directly address geometrically consistent partial shape matching.

Pose Transfer

Revisiting Map Relations for Unsupervised Non-Rigid Shape Matching

no code implementations17 Oct 2023 Dongliang Cao, Paul Roetzer, Florian Bernard

To this end, we propose a self-adaptive functional map solver to adjust the functional map regularisation for different shape matching scenarios, together with a vertex-wise contrastive loss to obtain more discriminative features.

Non-Negative Spherical Relaxations for Universe-Free Multi-Matching and Clustering

no code implementations20 Oct 2023 Johan Thunberg, Florian Bernard

We propose a novel non-negative spherical relaxation for optimization problems over binary matrices with injectivity constraints, which in particular has applications in multi-matching and clustering.

Clustering

Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation

no code implementations29 Feb 2024 Dongliang Cao, Marvin Eisenberger, Nafie El Amrani, Daniel Cremers, Florian Bernard

On the one hand, by incorporating spatial maps, our method obtains more accurate and smooth point-wise correspondences compared to previous functional map methods for shape matching.

Test-time Adaptation valid

Cannot find the paper you are looking for? You can Submit a new open access paper.