Search Results for author: Paul Guerrero

Found 37 papers, 18 papers with code

Points2Surf Learning Implicit Surfaces from Point Clouds

1 code implementation ECCV 2020 Philipp Erler, Paul Guerrero, Stefan Ohrhallinger, Niloy J. Mitra, Michael Wimmer

Hence, deep learning based methods have recently been proposed to produce complete surfaces, even from partial scans.

Surface Reconstruction

SuperGaussian: Repurposing Video Models for 3D Super Resolution

no code implementations2 Jun 2024 Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Frühstück

We demonstrate that it is possible to directly repurpose existing (pretrained) video models for 3D super-resolution and thus sidestep the problem of the shortage of large repositories of high-quality 3D training models.

Super-Resolution

PPSURF: Combining Patches and Point Convolutions for Detailed Surface Reconstruction

1 code implementation16 Jan 2024 Philipp Erler, Lizeth Fuentes, Pedro Hermosilla, Paul Guerrero, Renato Pajarola, Michael Wimmer

3D surface reconstruction from point clouds is a key step in areas such as content creation, archaeology, digital cultural heritage, and engineering.

Surface Reconstruction

Diffusion Handles Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D

no code implementations CVPR 2024 Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy J. Mitra

Diffusion handles is a novel approach to enable 3D object edits on diffusion images requiring only existing pre-trained diffusion models depth estimation without any fine-tuning or 3D object retrieval.

3D Object Retrieval Depth Estimation +2

Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D

no code implementations2 Dec 2023 Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy Mitra

Our key insight is to lift diffusion activations for an object to 3D using a proxy depth, 3D-transform the depth and associated activations, and project them back to image space.

3D Object Retrieval Depth Estimation +2

Explorable Mesh Deformation Subspaces from Unstructured Generative Models

no code implementations11 Oct 2023 Arman Maesumi, Paul Guerrero, Vladimir G. Kim, Matthew Fisher, Siddhartha Chaudhuri, Noam Aigerman, Daniel Ritchie

Deep generative models of 3D shapes often feature continuous latent spaces that can, in principle, be used to explore potential variations starting from a set of input shapes.

PhotoMat: A Material Generator Learned from Single Flash Photos

no code implementations20 May 2023 Xilong Zhou, Miloš Hašan, Valentin Deschaintre, Paul Guerrero, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Nima Khademi Kalantari

Instead, we train a generator for a neural material representation that is rendered with a learned relighting module to create arbitrarily lit RGB images; these are compared against real photos using a discriminator.

ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured Primitives

1 code implementation9 May 2023 R. Kenny Jones, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie

The discovered abstractions capture common patterns (both structural and parametric) across the dataset, so that programs rewritten with these abstractions are more compact, and expose fewer degrees of freedom.

Unsupervised 3D Shape Reconstruction by Part Retrieval and Assembly

no code implementations CVPR 2023 Xianghao Xu, Paul Guerrero, Matthew Fisher, Siddhartha Chaudhuri, Daniel Ritchie

We instead propose to decompose shapes using a library of 3D parts provided by the user, giving full control over the choice of parts.

3D Shape Reconstruction Retrieval

3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models

no code implementations1 Dec 2022 Gimin Nam, Mariem Khlifi, Andrew Rodriguez, Alberto Tono, Linqi Zhou, Paul Guerrero

We propose a diffusion model for neural implicit representations of 3D shapes that operates in the latent space of an auto-decoder.

3D Generation 3D Shape Generation +4

Search for Concepts: Discovering Visual Concepts Using Direct Optimization

no code implementations25 Oct 2022 Pradyumna Reddy, Paul Guerrero, Niloy J. Mitra

Finding an unsupervised decomposition of an image into individual objects is a key step to leverage compositionality and to perform symbolic reasoning.

NeuForm: Adaptive Overfitting for Neural Shape Editing

no code implementations18 Jul 2022 Connor Z. Lin, Niloy J. Mitra, Gordon Wetzstein, Leonidas Guibas, Paul Guerrero

Neural representations are popular for representing shapes, as they can be learned form sensor data and used for data cleanup, model completion, shape editing, and shape synthesis.

TileGen: Tileable, Controllable Material Generation and Capture

no code implementations12 Jun 2022 Xilong Zhou, Miloš Hašan, Valentin Deschaintre, Paul Guerrero, Kalyan Sunkavalli, Nima Kalantari

The resulting materials are tileable, can be larger than the target image, and are editable by varying the condition.

Inverse Rendering

COFS: Controllable Furniture layout Synthesis

no code implementations29 May 2022 Wamiq Reyaz Para, Paul Guerrero, Niloy Mitra, Peter Wonka

Scalable generation of furniture layouts is essential for many applications in virtual reality, augmented reality, game development and synthetic data generation.

Language Modelling Synthetic Data Generation

Neural Convolutional Surfaces

no code implementations CVPR 2022 Luca Morreale, Noam Aigerman, Paul Guerrero, Vladimir G. Kim, Niloy J. Mitra

Our pipeline and architecture are designed so that disentanglement of global geometry from local details is accomplished through optimization, in a completely unsupervised manner.

Disentanglement

LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Data

1 code implementation1 Feb 2022 Kurt Leimer, Paul Guerrero, Tomer Weiss, Przemyslaw Musialski

In practice, desirable layout properties may not exist in a dataset, for instance, specific expert knowledge can be missing in the data.

The Shape Part Slot Machine: Contact-based Reasoning for Generating 3D Shapes from Parts

no code implementations1 Dec 2021 Kai Wang, Paul Guerrero, Vladimir Kim, Siddhartha Chaudhuri, Minhyuk Sung, Daniel Ritchie

We present the Shape Part Slot Machine, a new method for assembling novel 3D shapes from existing parts by performing contact-based reasoning.

Diversity Graph Neural Network

Differentiable Surface Triangulation

1 code implementation22 Sep 2021 Marie-Julie Rakotosaona, Noam Aigerman, Niloy Mitra, Maks Ovsjanikov, Paul Guerrero

Our method builds on the result that any 2D triangulation can be achieved by a suitably perturbed weighted Delaunay triangulation.

ShapeMOD: Macro Operation Discovery for 3D Shape Programs

1 code implementation13 Apr 2021 R. Kenny Jones, David Charatan, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie

In this paper, we present ShapeMOD, an algorithm for automatically discovering macros that are useful across large datasets of 3D shape programs.

Learning Delaunay Surface Elements for Mesh Reconstruction

1 code implementation CVPR 2021 Marie-Julie Rakotosaona, Paul Guerrero, Noam Aigerman, Niloy Mitra, Maks Ovsjanikov

We leverage the properties of 2D Delaunay triangulations to construct a mesh from manifold surface elements.

Discovering Pattern Structure Using Differentiable Compositing

1 code implementation17 Oct 2020 Pradyumna Reddy, Paul Guerrero, Matt Fisher, Wilmot Li, Miloy J. Mitra

Patterns, which are collections of elements arranged in regular or near-regular arrangements, are an important graphic art form and widely used due to their elegant simplicity and aesthetic appeal.

Pix2Surf: Learning Parametric 3D Surface Models of Objects from Images

1 code implementation ECCV 2020 Jiahui Lei, Srinath Sridhar, Paul Guerrero, Minhyuk Sung, Niloy Mitra, Leonidas J. Guibas

We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views.

Points2Surf: Learning Implicit Surfaces from Point Cloud Patches

2 code implementations20 Jul 2020 Philipp Erler, Paul Guerrero, Stefan Ohrhallinger, Michael Wimmer, Niloy J. Mitra

Hence, deep learning based methods have recently been proposed to produce complete surfaces, even from partial scans.

StructEdit: Learning Structural Shape Variations

1 code implementation CVPR 2020 Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy Mitra, Leonidas J. Guibas

Learning to encode differences in the geometry and (topological) structure of the shapes of ordinary objects is key to generating semantically plausible variations of a given shape, transferring edits from one shape to another, and many other applications in 3D content creation.

StructureNet: Hierarchical Graph Networks for 3D Shape Generation

2 code implementations1 Aug 2019 Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy Mitra, Leonidas J. Guibas

We introduce StructureNet, a hierarchical graph network which (i) can directly encode shapes represented as such n-ary graphs; (ii) can be robustly trained on large and complex shape families; and (iii) can be used to generate a great diversity of realistic structured shape geometries.

3D Shape Generation

PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Clouds

1 code implementation4 Jan 2019 Marie-Julie Rakotosaona, Vittorio La Barbera, Paul Guerrero, Niloy J. Mitra, Maks Ovsjanikov

Point clouds obtained with 3D scanners or by image-based reconstruction techniques are often corrupted with significant amount of noise and outliers.

Denoising Surface Reconstruction

iMapper: Interaction-guided Joint Scene and Human Motion Mapping from Monocular Videos

no code implementations20 Jun 2018 Aron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, Niloy J. Mitra

A long-standing challenge in scene analysis is the recovery of scene arrangements under moderate to heavy occlusion, directly from monocular video.

Human-Object Interaction Detection Object

FrankenGAN: Guided Detail Synthesis for Building Mass-Models Using Style-Synchonized GANs

2 code implementations19 Jun 2018 Tom Kelly, Paul Guerrero, Anthony Steed, Peter Wonka, Niloy J. Mitra

The various GANs are synchronized to produce consistent style distributions over buildings and neighborhoods.

Graphics

PCPNET: Learning Local Shape Properties from Raw Point Clouds

33 code implementations13 Oct 2017 Paul Guerrero, Yanir Kleiman, Maks Ovsjanikov, Niloy J. Mitra

In this paper, we propose PCPNet, a deep-learning based approach for estimating local 3D shape properties in point clouds.

Computational Geometry

DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels

no code implementations22 May 2017 Paul Guerrero, Holger Winnemöller, Wilmot Li, Niloy J. Mitra

In the context of scene understanding, a variety of methods exists to estimate different information channels from mono or stereo images, including disparity, depth, and normals.

Scene Understanding Segmentation

RAID: A Relation-Augmented Image Descriptor

no code implementations5 Oct 2015 Paul Guerrero, Niloy J. Mitra, Peter Wonka

As humans, we regularly interpret images based on the relations between image regions.

Relation

Cannot find the paper you are looking for? You can Submit a new open access paper.