Search Results for author: Peter Eisert

Found 41 papers, 8 papers with code

SPVLoc: Semantic Panoramic Viewport Matching for 6D Camera Localization in Unseen Environments

1 code implementation16 Apr 2024 Niklas Gard, Anna Hilsmann, Peter Eisert

In this paper, we present SPVLoc, a global indoor localization method that accurately determines the six-dimensional (6D) camera pose of a query image and requires minimal scene-specific prior knowledge and no scene-specific training.

Camera Localization Indoor Localization

Gaussian Splatting Decoder for 3D-aware Generative Adversarial Networks

no code implementations16 Apr 2024 Florian Barthel, Arian Beckmann, Wieland Morgenstern, Anna Hilsmann, Peter Eisert

By training a decoder that maps implicit NeRF representations to explicit 3D Gaussian Splatting attributes, we can integrate the representational diversity and quality of 3D GANs into the ecosystem of 3D Gaussian Splatting for the first time.

Video-Driven Animation of Neural Head Avatars

no code implementations7 Mar 2024 Wolfgang Paier, Paul Hinzer, Anna Hilsmann, Peter Eisert

We present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input.

Compact 3D Scene Representation via Self-Organizing Gaussian Grids

1 code implementation19 Dec 2023 Wieland Morgenstern, Florian Barthel, Anna Hilsmann, Peter Eisert

In this paper, we introduce a compact scene representation organizing the parameters of 3D Gaussian Splatting (3DGS) into a 2D grid with local homogeneity, ensuring a drastic reduction in storage requirements without compromising visual quality during rendering.

Multispectral Stereo-Image Fusion for 3D Hyperspectral Scene Reconstruction

no code implementations15 Dec 2023 Eric L. Wisotzky, Jost Triller, Anna Hilsmann, Peter Eisert

To address these drawbacks, we present a novel approach combining two calibrated multispectral real-time capable snapshot cameras, covering different spectral ranges, into a stereo-system.

3D Reconstruction

Towards Better Morphed Face Images without Ghosting Artifacts

no code implementations13 Dec 2023 Clemens Seibold, Anna Hilsmann, Peter Eisert

Furthermore, we show that our approach does not impair the biometric quality, which is essential for high quality morphs.

MORPH Style Transfer

Multi-view Inversion for 3D-aware Generative Adversarial Networks

1 code implementation8 Dec 2023 Florian Barthel, Anna Hilsmann, Peter Eisert

Current 3D GAN inversion methods for human heads typically use only one single frontal image to reconstruct the whole 3D head model.

Multi-task Planar Reconstruction with Feature Warping Guidance

1 code implementation25 Nov 2023 Luan Wei, Anna Hilsmann, Peter Eisert

We introduce SOLOPlanes, a real-time planar reconstruction model based on a modified instance segmentation architecture which simultaneously predicts semantics for each plane instance, along with plane parameters and piece-wise plane instance masks.

3D Reconstruction Instance Segmentation +4

Animating NeRFs from Texture Space: A Framework for Pose-Dependent Rendering of Human Performances

no code implementations6 Nov 2023 Paul Knoll, Wieland Morgenstern, Anna Hilsmann, Peter Eisert

The extension to a controllable synthesis of dynamic human performances poses an exciting research question.

Human-Centered Evaluation of XAI Methods

no code implementations11 Oct 2023 Karam Dawoud, Wojciech Samek, Peter Eisert, Sebastian Lapuschkin, Sebastian Bosse

In the ever-evolving field of Artificial Intelligence, a critical challenge has been to decipher the decision-making processes within the so-called "black boxes" in deep learning.

Decision Making Image Classification

BTSeg: Barlow Twins Regularization for Domain Adaptation in Semantic Segmentation

no code implementations31 Aug 2023 Johannes Künzel, Anna Hilsmann, Peter Eisert

We introduce BTSeg, an innovative, semi-supervised training approach enhancing semantic segmentation models in order to effectively handle a range of adverse conditions without requiring the creation of extensive new datasets.

Autonomous Driving Domain Adaptation +2

A differentiable Gaussian Prototype Layer for explainable Segmentation

no code implementations25 Jun 2023 Michael Gerstenberger, Steffen Maaß, Peter Eisert, Sebastian Bosse

We introduce a Gaussian Prototype Layer for gradient-based prototype learning and demonstrate two novel network architectures for explainable segmentation one of which relies on region proposals.

Superpixels

Unsupervised Learning of Style-Aware Facial Animation from Real Acting Performances

no code implementations16 Jun 2023 Wolfgang Paier, Anna Hilsmann, Peter Eisert

This paper presents a novel approach for text/speech-driven animation of a photo-realistic head model based on blend-shape geometry, dynamic textures, and neural rendering.

Neural Rendering

Automatic Reconstruction of Semantic 3D Models from 2D Floor Plans

no code implementations2 Jun 2023 Aleixo Cambeiro Barreiro, Mariusz Trzeciakiewicz, Anna Hilsmann, Peter Eisert

Digitalization of existing buildings and the creation of 3D BIM models for them has become crucial for many tasks.

Towards L-System Captioning for Tree Reconstruction

no code implementations10 May 2023 Jannes S. Magnusson, Anna Hilsmann, Peter Eisert

This work proposes a novel concept for tree and plant reconstruction by directly inferring a Lindenmayer-System (L-System) word representation from image data in an image captioning approach.

Image Captioning

Fooling State-of-the-Art Deepfake Detection with High-Quality Deepfakes

no code implementations9 May 2023 Arian Beckmann, Anna Hilsmann, Peter Eisert

Due to the rising threat of deepfakes to security and privacy, it is most important to develop robust and reliable detectors.

DeepFake Detection Face Swapping +1

Dynamic Multi-View Scene Reconstruction Using Neural Implicit Surface

no code implementations28 Feb 2023 Decai Chen, Haofei Lu, Ingo Feldmann, Oliver Schreer, Peter Eisert

Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is under-constrained and noisy.

Novel View Synthesis Surface Reconstruction

Hyperspectral Demosaicing of Snapshot Camera Images Using Deep Learning

no code implementations21 Nov 2022 Eric L. Wisotzky, Charul Daudkhane, Anna Hilsmann, Peter Eisert

The dataset is a combination of real captured scenes with images from publicly available data adapted to the 4x4 mosaic pattern.

Demosaicking

CASAPose: Class-Adaptive and Semantic-Aware Multi-Object Pose Estimation

1 code implementation11 Oct 2022 Niklas Gard, Anna Hilsmann, Peter Eisert

Applications in the field of augmented reality or robotics often require joint localisation and 6D pose estimation of multiple objects.

6D Pose Estimation 6D Pose Estimation using RGB +3

Perfusion assessment via local remote photoplethysmography (rPPG)

no code implementations29 Aug 2022 Benjamin Kossack, Eric Wisotzky, Peter Eisert, Sebastian P. Schraven, Brigitta Globke, Anna Hilsmann

From the extracted signals, we derive the signal-to-noise ratio, magnitude in the frequency domain, heart rate, perfusion index as well as correlation between specific rPPG signals in order to locally assess the perfusion of a specific region of human tissue.

But that's not why: Inference adjustment by interactive prototype revision

no code implementations18 Mar 2022 Michael Gerstenberger, Sebastian Lapuschkin, Peter Eisert, Sebastian Bosse

It shows that even correct classifications can rely on unreasonable prototypes that result from confounding variables in a dataset.

BIG-bench Machine Learning Decision Making

Accurate Human Body Reconstruction for Volumetric Video

no code implementations26 Feb 2022 Decai Chen, Markus Worchel, Ingo Feldmann, Oliver Schreer, Peter Eisert

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras.

Stereo Matching Video Reconstruction

Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation

no code implementations7 Feb 2022 Alexandra Zimmer, Anna Hilsmann, Wieland Morgenstern, Peter Eisert

In detail, we derive parameters of a sequence of body models, representing shape and motion of a person, including jaw poses, facial expressions, and finger poses.

Pose Estimation

From Explanations to Segmentation: Using Explainable AI for Image Segmentation

no code implementations1 Feb 2022 Clemens Seibold, Johannes Künzel, Anna Hilsmann, Peter Eisert

The new era of image segmentation leveraging the power of Deep Neural Nets (DNNs) comes with a price tag: to train a neural network for pixel-wise segmentation, a large amount of training samples has to be manually labeled on pixel-precision.

Explainable Artificial Intelligence (XAI) Image Segmentation +3

Combining Local and Global Pose Estimation for Precise Tracking of Similar Objects

no code implementations31 Jan 2022 Niklas Gard, Anna Hilsmann, Peter Eisert

In this paper, we present a multi-object 6D detection and tracking pipeline for potentially similar and non-textured objects.

Object Pose Estimation

Automated Damage Inspection of Power Transmission Towers from UAV Images

no code implementations30 Nov 2021 Aleixo Cambeiro Barreiro, Clemens Seibold, Anna Hilsmann, Peter Eisert

Recently, the use of drones or helicopters for remote recording is increasing in the industry, sparing the technicians this perilous task.

Zero in on Shape: A Generic 2D-3D Instance Similarity Metric learned from Synthetic Data

no code implementations9 Aug 2021 Maciej Janik, Niklas Gard, Anna Hilsmann, Peter Eisert

We present a network architecture which compares RGB images and untextured 3D models by the similarity of the represented shape.

Retrieval

Focused LRP: Explainable AI for Face Morphing Attack Detection

no code implementations26 Mar 2021 Clemens Seibold, Anna Hilsmann, Peter Eisert

This evaluation framework is based on removing detected artifacts and analyzing the influence of these changes on the decision of the DNN.

Decision Making Face Morphing Attack Detection

Neural Face Models for Example-Based Visual Speech Synthesis

no code implementations22 Sep 2020 Wolfgang Paier, Anna Hilsmann, Peter Eisert

We solve these problems by combining the realism and simplicity of example-based animations with the advantages of neural face models.

Face Model Speech Synthesis

Going beyond Free Viewpoint: Creating Animatable Volumetric Video of Human Performances

no code implementations2 Sep 2020 Anna Hilsmann, Philipp Fechteler, Wieland Morgenstern, Wolfgang Paier, Ingo Feldmann, Oliver Schreer, Peter Eisert

Going beyond the application of free-viewpoint volumetric video, we allow re-animation and alteration of an actor's performance through (i) the enrichment of the captured data with semantics and animation properties and (ii) applying hybrid geometry- and video-based animation methods that allow a direct animation of the high-quality data itself instead of creating an animatable model that resembles the captured data.

Style Your Face Morph and Improve Your Face Morphing Attack Detector

no code implementations23 Apr 2020 Clemens Seibold, Anna Hilsmann, Peter Eisert

A morphed face image is a synthetically created image that looks so similar to the faces of two subjects that both can use it for verification against a biometric verification system.

Face Morphing Attack Detection MORPH +1

Automatic Analysis of Sewer Pipes Based on Unrolled Monocular Fisheye Images

no code implementations11 Dec 2019 Johannes Künzel, Thomas Werner, Ronja Möller, Peter Eisert, Jan Waschnewski, Ralf Hilpert

The task of detecting and classifying damages in sewer pipes offers an important application area for computer vision algorithms.

Cannot find the paper you are looking for? You can Submit a new open access paper.