1 code implementation • ECCV 2020 • Philipp Erler, Paul Guerrero, Stefan Ohrhallinger, Niloy J. Mitra, Michael Wimmer
Hence, deep learning based methods have recently been proposed to produce complete surfaces, even from partial scans.
no code implementations • 2 Jun 2024 • Yuan Shen, Duygu Ceylan, Paul Guerrero, Zexiang Xu, Niloy J. Mitra, Shenlong Wang, Anna Frühstück
We demonstrate that it is possible to directly repurpose existing (pretrained) video models for 3D super-resolution and thus sidestep the problem of the shortage of large repositories of high-quality 3D training models.
no code implementations • 1 May 2024 • Julia Guerrero-Viu, Milos Hasan, Arthur Roullier, Midhun Harikumar, Yiwei Hu, Paul Guerrero, Diego Gutierrez, Belen Masia, Valentin Deschaintre
Generative models have enabled intuitive image creation and manipulation using natural language.
1 code implementation • 16 Jan 2024 • Philipp Erler, Lizeth Fuentes, Pedro Hermosilla, Paul Guerrero, Renato Pajarola, Michael Wimmer
3D surface reconstruction from point clouds is a key step in areas such as content creation, archaeology, digital cultural heritage, and engineering.
no code implementations • CVPR 2024 • Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy J. Mitra
Diffusion handles is a novel approach to enable 3D object edits on diffusion images requiring only existing pre-trained diffusion models depth estimation without any fine-tuning or 3D object retrieval.
no code implementations • 2 Dec 2023 • Karran Pandey, Paul Guerrero, Matheus Gadelha, Yannick Hold-Geoffroy, Karan Singh, Niloy Mitra
Our key insight is to lift diffusion activations for an object to 3D using a proxy depth, 3D-transform the depth and associated activations, and project them back to image space.
no code implementations • 11 Oct 2023 • Arman Maesumi, Paul Guerrero, Vladimir G. Kim, Matthew Fisher, Siddhartha Chaudhuri, Noam Aigerman, Daniel Ritchie
Deep generative models of 3D shapes often feature continuous latent spaces that can, in principle, be used to explore potential variations starting from a set of input shapes.
no code implementations • 20 May 2023 • Xilong Zhou, Miloš Hašan, Valentin Deschaintre, Paul Guerrero, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Nima Khademi Kalantari
Instead, we train a generator for a neural material representation that is rendered with a learned relighting module to create arbitrarily lit RGB images; these are compared against real photos using a discriminator.
1 code implementation • 9 May 2023 • R. Kenny Jones, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie
The discovered abstractions capture common patterns (both structural and parametric) across the dataset, so that programs rewritten with these abstractions are more compact, and expose fewer degrees of freedom.
no code implementations • CVPR 2023 • Xianghao Xu, Paul Guerrero, Matthew Fisher, Siddhartha Chaudhuri, Daniel Ritchie
We instead propose to decompose shapes using a library of 3D parts provided by the user, giving full control over the choice of parts.
no code implementations • 1 Dec 2022 • Gimin Nam, Mariem Khlifi, Andrew Rodriguez, Alberto Tono, Linqi Zhou, Paul Guerrero
We propose a diffusion model for neural implicit representations of 3D shapes that operates in the latent space of an auto-decoder.
1 code implementation • CVPR 2023 • Titas Anciukevičius, Zexiang Xu, Matthew Fisher, Paul Henderson, Hakan Bilen, Niloy J. Mitra, Paul Guerrero
In this paper, we present RenderDiffusion, the first diffusion model for 3D generation and inference, trained using only monocular 2D supervision.
no code implementations • 25 Oct 2022 • Pradyumna Reddy, Paul Guerrero, Niloy J. Mitra
Finding an unsupervised decomposition of an image into individual objects is a key step to leverage compositionality and to perform symbolic reasoning.
no code implementations • 18 Jul 2022 • Connor Z. Lin, Niloy J. Mitra, Gordon Wetzstein, Leonidas Guibas, Paul Guerrero
Neural representations are popular for representing shapes, as they can be learned form sensor data and used for data cleanup, model completion, shape editing, and shape synthesis.
no code implementations • 12 Jun 2022 • Xilong Zhou, Miloš Hašan, Valentin Deschaintre, Paul Guerrero, Kalyan Sunkavalli, Nima Kalantari
The resulting materials are tileable, can be larger than the target image, and are editable by varying the condition.
no code implementations • 29 May 2022 • Wamiq Reyaz Para, Paul Guerrero, Niloy Mitra, Peter Wonka
Scalable generation of furniture layouts is essential for many applications in virtual reality, augmented reality, game development and synthetic data generation.
no code implementations • CVPR 2022 • Luca Morreale, Noam Aigerman, Paul Guerrero, Vladimir G. Kim, Niloy J. Mitra
Our pipeline and architecture are designed so that disentanglement of global geometry from local details is accomplished through optimization, in a completely unsupervised manner.
1 code implementation • 1 Feb 2022 • Kurt Leimer, Paul Guerrero, Tomer Weiss, Przemyslaw Musialski
In practice, desirable layout properties may not exist in a dataset, for instance, specific expert knowledge can be missing in the data.
no code implementations • 1 Dec 2021 • Kai Wang, Paul Guerrero, Vladimir Kim, Siddhartha Chaudhuri, Minhyuk Sung, Daniel Ritchie
We present the Shape Part Slot Machine, a new method for assembling novel 3D shapes from existing parts by performing contact-based reasoning.
1 code implementation • 22 Sep 2021 • Marie-Julie Rakotosaona, Noam Aigerman, Niloy Mitra, Maks Ovsjanikov, Paul Guerrero
Our method builds on the result that any 2D triangulation can be achieved by a suitably perturbed weighted Delaunay triangulation.
no code implementations • NeurIPS 2021 • Wamiq Reyaz Para, Shariq Farooq Bhat, Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas Guibas, Peter Wonka
Sketches can be represented as graphs, with the primitives as nodes and the constraints as edges.
1 code implementation • 13 Apr 2021 • R. Kenny Jones, David Charatan, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie
In this paper, we present ShapeMOD, an algorithm for automatically discovering macros that are useful across large datasets of 3D shape programs.
1 code implementation • CVPR 2021 • Marie-Julie Rakotosaona, Paul Guerrero, Noam Aigerman, Niloy Mitra, Maks Ovsjanikov
We leverage the properties of 2D Delaunay triangulations to construct a mesh from manifold surface elements.
no code implementations • ICCV 2021 • Wamiq Para, Paul Guerrero, Tom Kelly, Leonidas Guibas, Peter Wonka
We generate layouts in three steps.
1 code implementation • 17 Oct 2020 • Pradyumna Reddy, Paul Guerrero, Matt Fisher, Wilmot Li, Miloy J. Mitra
Patterns, which are collections of elements arranged in regular or near-regular arrangements, are an important graphic art form and widely used due to their elegant simplicity and aesthetic appeal.
1 code implementation • 17 Sep 2020 • R. Kenny Jones, Theresa Barton, Xianghao Xu, Kai Wang, Ellen Jiang, Paul Guerrero, Niloy J. Mitra, Daniel Ritchie
The program captures the subset of variability that is interpretable and editable.
1 code implementation • ECCV 2020 • Jiahui Lei, Srinath Sridhar, Paul Guerrero, Minhyuk Sung, Niloy Mitra, Leonidas J. Guibas
We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views.
2 code implementations • 20 Jul 2020 • Philipp Erler, Paul Guerrero, Stefan Ohrhallinger, Michael Wimmer, Niloy J. Mitra
Hence, deep learning based methods have recently been proposed to produce complete surfaces, even from partial scans.
1 code implementation • CVPR 2020 • Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy Mitra, Leonidas J. Guibas
Learning to encode differences in the geometry and (topological) structure of the shapes of ordinary objects is key to generating semantically plausible variations of a given shape, transferring edits from one shape to another, and many other applications in 3D content creation.
2 code implementations • 1 Aug 2019 • Kaichun Mo, Paul Guerrero, Li Yi, Hao Su, Peter Wonka, Niloy Mitra, Leonidas J. Guibas
We introduce StructureNet, a hierarchical graph network which (i) can directly encode shapes represented as such n-ary graphs; (ii) can be robustly trained on large and complex shape families; and (iii) can be used to generate a great diversity of realistic structured shape geometries.
1 code implementation • 4 Jan 2019 • Marie-Julie Rakotosaona, Vittorio La Barbera, Paul Guerrero, Niloy J. Mitra, Maks Ovsjanikov
Point clouds obtained with 3D scanners or by image-based reconstruction techniques are often corrupted with significant amount of noise and outliers.
1 code implementation • SIGGRAPH Asia 2018 • Tom Kelly, Paul Guerrero, Anthony Steed, Peter Wonka, Niloy J. Mitra
The various GANs are synchronized to produce consistent style distributions over buildings and neighborhoods.
no code implementations • 20 Jun 2018 • Aron Monszpart, Paul Guerrero, Duygu Ceylan, Ersin Yumer, Niloy J. Mitra
A long-standing challenge in scene analysis is the recovery of scene arrangements under moderate to heavy occlusion, directly from monocular video.
2 code implementations • 19 Jun 2018 • Tom Kelly, Paul Guerrero, Anthony Steed, Peter Wonka, Niloy J. Mitra
The various GANs are synchronized to produce consistent style distributions over buildings and neighborhoods.
Graphics
33 code implementations • 13 Oct 2017 • Paul Guerrero, Yanir Kleiman, Maks Ovsjanikov, Niloy J. Mitra
In this paper, we propose PCPNet, a deep-learning based approach for estimating local 3D shape properties in point clouds.
Computational Geometry
no code implementations • 22 May 2017 • Paul Guerrero, Holger Winnemöller, Wilmot Li, Niloy J. Mitra
In the context of scene understanding, a variety of methods exists to estimate different information channels from mono or stereo images, including disparity, depth, and normals.
no code implementations • 5 Oct 2015 • Paul Guerrero, Niloy J. Mitra, Peter Wonka
As humans, we regularly interpret images based on the relations between image regions.