Search Results for author: Nikolaos Sarafianos

Found 21 papers, 4 papers with code

Garment3DGen: 3D Garment Stylization and Texture Generation

no code implementations27 Mar 2024 Nikolaos Sarafianos, Tuur Stuyck, Xiaoyu Xiang, Yilei Li, Jovan Popovic, Rakesh Ranjan

We present a plethora of quantitative and qualitative comparisons on various assets both real and generated and provide use-cases of how one can generate simulation-ready 3D garments.

Image to 3D Texture Synthesis

ANIM: Accurate Neural Implicit Model for Human Reconstruction from a single RGB-D image

no code implementations15 Mar 2024 Marco Pesavento, Yuanlu Xu, Nikolaos Sarafianos, Robert Maier, Ziyan Wang, Chun-Han Yao, Marco Volino, Edmond Boyer, Adrian Hilton, Tony Tung

In this paper, we explore the benefits of incorporating depth observations in the reconstruction process by introducing ANIM, a novel method that reconstructs arbitrary 3D human shapes from single-view RGB-D images with an unprecedented level of accuracy.

HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstruction

no code implementations28 Dec 2023 Angtian Wang, Yuanlu Xu, Nikolaos Sarafianos, Robert Maier, Edmond Boyer, Alan Yuille, Tony Tung

This representation is composed of two surface layers that represent opaque and translucent regions on the clothed human body.

3D Human Reconstruction

DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation

no code implementations20 Nov 2023 Yifei Li, Hsiao-yu Chen, Egor Larionov, Nikolaos Sarafianos, Wojciech Matusik, Tuur Stuyck

By integrating physical simulation into the optimization loop and accounting for the complex nonlinear behavior of cloth and its intricate interaction with the body, our framework recovers body and garment geometry and extracts important material parameters in a physically plausible way.

Physical Simulations

NSF: Neural Surface Fields for Human Modeling from Monocular Depth

no code implementations ICCV 2023 Yuxuan Xue, Bharat Lal Bhatnagar, Riccardo Marin, Nikolaos Sarafianos, Yuanlu Xu, Gerard Pons-Moll, Tony Tung

Compared to existing approaches, our method eliminates the expensive per-frame surface extraction while maintaining mesh coherency, and is capable of reconstructing meshes with arbitrary resolution without retraining.

Computational Efficiency Virtual Try-on

VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANs

1 code implementation CVPR 2023 Anna Frühstück, Nikolaos Sarafianos, Yuanlu Xu, Peter Wonka, Tony Tung

Our experiments demonstrate that VIVE3D generates high-fidelity face edits at consistent quality from a range of camera viewpoints which are composited with the original video in a temporally and spatially consistent manner.

Optical Flow Estimation Video Editing

Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields

1 code implementation27 Jul 2022 Garvita Tiwari, Dimitrije Antic, Jan Eric Lenssen, Nikolaos Sarafianos, Tony Tung, Gerard Pons-Moll

The resulting high-dimensional implicit function can be differentiated with respect to the input poses and thus can be used to project arbitrary poses onto the manifold by using gradient descent on the set of 3-dimensional hyperspheres.

Denoising

BodyMap: Learning Full-Body Dense Correspondence Map

no code implementations CVPR 2022 Anastasia Ianina, Nikolaos Sarafianos, Yuanlu Xu, Ignacio Rocco, Tony Tung

Dense correspondence between humans carries powerful semantic information that can be utilized to solve fundamental problems for full-body understanding such as in-the-wild surface matching, tracking and reconstruction.

Neural Rendering Novel View Synthesis

Neural Rendering of Humans in Novel View and Pose from Monocular Video

no code implementations4 Apr 2022 Tiantian Wang, Nikolaos Sarafianos, Ming-Hsuan Yang, Tony Tung

We accomplish this by utilizing both the human pose that models the body shape as well as point clouds that partially cover the human as input.

Neural Rendering

SPAMs: Structured Implicit Parametric Models

no code implementations CVPR 2022 Pablo Palafox, Nikolaos Sarafianos, Tony Tung, Angela Dai

We observe that deformable object motion is often semantically structured, and thus propose to learn Structured-implicit PArametric Models (SPAMs) as a deformable object representation that structurally decomposes non-rigid object motion into part-based disentangled representations of shape and pose, with each being represented by deep implicit functions.

Object

Free-Viewpoint RGB-D Human Performance Capture and Rendering

no code implementations27 Dec 2021 Phong Nguyen-Ha, Nikolaos Sarafianos, Christoph Lassner, Janne Heikkila, Tony Tung

While prior work has shown impressive performance capture results in laboratory settings, it is non-trivial to achieve casual free-viewpoint human capture and rendering for unseen identities with high fidelity, especially for facial expressions, hands, and clothes.

Neural Rendering Novel View Synthesis

Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothing

1 code implementation ICCV 2021 Garvita Tiwari, Nikolaos Sarafianos, Tony Tung, Gerard Pons-Moll

Neural-GIF can be trained on raw 3D scans and reconstructs detailed complex surface geometry and deformations.

Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humans

no code implementations CVPR 2021 Bindita Chaudhuri, Nikolaos Sarafianos, Linda Shapiro, Tony Tung

Given a segmentation mask defining the layout of the semantic regions in the texture map, our network generates high-resolution textures with a variety of styles, that are then used for rendering purposes.

Virtual Try-on Vocal Bursts Intensity Prediction

On Improving the Generalization of Face Recognition in the Presence of Occlusions

no code implementations11 Jun 2020 Xiang Xu, Nikolaos Sarafianos, Ioannis A. Kakadiaris

In this paper, we address a key limitation of existing 2D face recognition methods: robustness to occlusions.

Face Recognition

Adversarial Representation Learning for Text-to-Image Matching

no code implementations ICCV 2019 Nikolaos Sarafianos, Xiang Xu, Ioannis A. Kakadiaris

For many computer vision applications such as image captioning, visual question answering, and person search, learning discriminative feature representations at both image and text level is an essential yet challenging problem.

Image Captioning Language Modelling +5

Deep Imbalanced Attribute Classification using Visual Attention Aggregation

2 code implementations ECCV 2018 Nikolaos Sarafianos, Xiang Xu, Ioannis A. Kakadiaris

For many computer vision applications, such as image description and human identification, recognizing the visual attributes of humans is an essential yet challenging problem.

Attribute Classification +1

Curriculum Learning of Visual Attribute Clusters for Multi-Task Classification

no code implementations19 Sep 2017 Nikolaos Sarafianos, Theodore Giannakopoulos, Christophoros Nikou, Ioannis A. Kakadiaris

In this paper, we introduce a novel method to combine the advantages of both multi-task and curriculum learning in a visual attribute classification framework.

Attribute Classification +2

Adaptive SVM+: Learning with Privileged Information for Domain Adaptation

no code implementations30 Aug 2017 Nikolaos Sarafianos, Michalis Vrigkas, Ioannis A. Kakadiaris

Incorporating additional knowledge in the learning process can be beneficial for several computer vision and machine learning tasks.

Domain Adaptation

Curriculum Learning for Multi-Task Classification of Visual Attributes

no code implementations29 Aug 2017 Nikolaos Sarafianos, Theodore Giannakopoulos, Christophoros Nikou, Ioannis A. Kakadiaris

Visual attributes, from simple objects (e. g., backpacks, hats) to soft-biometrics (e. g., gender, height, clothing) have proven to be a powerful representational approach for many applications such as image description and human identification.

Attribute Classification +2

Predicting Privileged Information for Height Estimation

no code implementations9 Feb 2017 Nikolaos Sarafianos, Christophoros Nikou, Ioannis A. Kakadiaris

In this paper, we propose a novel regression-based method for employing privileged information to estimate the height using human metrology.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.