Search Results for author: Angel X. Chang

Found 42 papers, 16 papers with code

Generalizing Single-View 3D Shape Retrieval to Occlusions and Unseen Objects

no code implementations31 Dec 2023 Qirui Wu, Daniel Ritchie, Manolis Savva, Angel X. Chang

Single-view 3D shape retrieval is a challenging task that is increasingly important with the growth of available 3D data.

3D Shape Retrieval Retrieval

BarcodeBERT: Transformers for Biodiversity Analysis

1 code implementation4 Nov 2023 Pablo Millan Arias, Niousha Sadjadi, Monireh Safari, ZeMing Gong, Austin T. Wang, Scott C. Lowe, Joakim Bruslund Haurum, Iuliia Zarubiieva, Dirk Steinke, Lila Kari, Angel X. Chang, Graham W. Taylor

Understanding biodiversity is a global challenge, in which DNA barcodes - short snippets of DNA that cluster by species - play a pivotal role.

Model Selection

Multi3DRefer: Grounding Text Description to Multiple 3D Objects

no code implementations ICCV 2023 Yiming Zhang, ZeMing Gong, Angel X. Chang

We introduce the task of localizing a flexible number of objects in real-world 3D scenes using natural language descriptions.

Contrastive Learning Object +3

Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation

no code implementations20 Jun 2023 Mukul Khanna, Yongsen Mao, Hanxiao Jiang, Sanjay Haresh, Brennan Shacklett, Dhruv Batra, Alexander Clegg, Eric Undersander, Angel X. Chang, Manolis Savva

Surprisingly, we observe that agents trained on just 122 scenes from our dataset outperform agents trained on 10, 000 scenes from the ProcTHOR-10K dataset in terms of zero-shot generalization in real-world scanned environments.

Navigate Zero-shot Generalization

Evaluating 3D Shape Analysis Methods for Robustness to Rotation Invariance

no code implementations29 May 2023 Supriya Gadi Patil, Angel X. Chang, Manolis Savva

Our study, on a synthetic dataset of 3D scenes where objects instances occur in different orientations, reveals that deep learning-based rotation invariant methods are effective for relatively easy settings with easy-to-distinguish pairs.

MOPA: Modular Object Navigation with PointGoal Agents

no code implementations7 Apr 2023 Sonia Raychaudhuri, Tommaso Campari, Unnat Jain, Manolis Savva, Angel X. Chang

We propose a simple but effective modular approach MOPA (Modular ObjectNav with PointGoal agents) to systematically investigate the inherent modularity of the object navigation task in Embodied AI.

Navigate Object +3

Exploiting Proximity-Aware Tasks for Embodied Social Navigation

no code implementations ICCV 2023 Enrico Cancelli, Tommaso Campari, Luciano Serafini, Angel X. Chang, Lamberto Ballan

In this paper, we propose an end-to-end architecture that exploits Proximity-Aware Tasks (referred as to Risk and Proximity Compass) to inject into a reinforcement learning navigation policy the ability to infer common-sense social behaviors.

Common Sense Reasoning Navigate +1

Understanding Pure CLIP Guidance for Voxel Grid NeRF Models

no code implementations30 Sep 2022 Han-Hung Lee, Angel X. Chang

We illustrate how different image-based augmentations prevent the adversarial generation problem, and how the generated results are impacted.

Text to 3D

OPD: Single-view 3D Openable Part Detection

1 code implementation30 Mar 2022 Hanxiao Jiang, Yongsen Mao, Manolis Savva, Angel X. Chang

The input is a single image of an object, and as output we detect what parts of the object can open, and the motion parameters describing the articulation of each openable part.

Object OPD: Single-view 3D Openable Part Detection

Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms

no code implementations10 Dec 2021 Kai Wang, Xianghao Xu, Leon Lei, Selena Ling, Natalie Lindsay, Angel X. Chang, Manolis Savva, Daniel Ritchie

We then discuss different strategies for solving the problem, and design two representative pipelines: one uses available 2D floor plans to guide selection and deformation of 3D rooms; the other learns to retrieve a set of compatible 3D rooms and combine them into novel layouts.

3D Reconstruction Autonomous Navigation +2

Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments

no code implementations EMNLP 2021 Sonia Raychaudhuri, Saim Wani, Shivansh Patel, Unnat Jain, Angel X. Chang

Prior work supervises the agent with actions based on the shortest path from the agent's location to the goal, but such goal-oriented supervision is often not in alignment with the instruction.

Vision and Language Navigation

Mirror3D: Depth Refinement for Mirror Surfaces

1 code implementation CVPR 2021 Jiaqi Tan, Weijie Lin, Angel X. Chang, Manolis Savva

Despite recent progress in depth sensing and 3D reconstruction, mirror surfaces are a significant source of errors.

3D Reconstruction Depth Estimation

Plan2Scene: Converting Floorplans to 3D Scenes

1 code implementation CVPR 2021 Madhawa Vidanapathirana, Qirui Wu, Yasutaka Furukawa, Angel X. Chang, Manolis Savva

We address the task of converting a floorplan and a set of associated photos of a residence into a textured 3D mesh model, a task which we call Plan2Scene.

Plan2Scene

MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigation

no code implementations NeurIPS 2020 Saim Wani, Shivansh Patel, Unnat Jain, Angel X. Chang, Manolis Savva

We propose the multiON task, which requires navigation to an episode-specific sequence of objects in a realistic environment.

Benchmarking Object

SAPIEN: A SimulAted Part-based Interactive ENvironment

1 code implementation CVPR 2020 Fanbo Xiang, Yuzhe Qin, Kaichun Mo, Yikuan Xia, Hao Zhu, Fangchen Liu, Minghua Liu, Hanxiao Jiang, Yifu Yuan, He Wang, Li Yi, Angel X. Chang, Leonidas J. Guibas, Hao Su

To achieve this task, a simulated environment with physically realistic simulation, sufficient articulated objects, and transferability to the real robot is indispensable.

Attribute

Mimic and Rephrase: Reflective Listening in Open-Ended Dialogue

no code implementations CONLL 2019 Justin Dieter, Tian Wang, Arun Tejasvi Chaganty, Gabor Angeli, Angel X. Chang

Reflective listening{--}demonstrating that you have heard your conversational partner{--}is key to effective communication.

Scan2CAD: Learning CAD Model Alignment in RGB-D Scans

2 code implementations CVPR 2019 Armen Avetisyan, Manuel Dahnert, Angela Dai, Manolis Savva, Angel X. Chang, Matthias Nießner

For a 3D reconstruction of an indoor scene, our method takes as input a set of CAD models, and predicts a 9DoF pose that aligns each model to the underlying scan geometry.

3D Reconstruction

Im2Pano3D: Extrapolating 360° Structure and Semantics Beyond the Field of View

no code implementations CVPR 2018 Shuran Song, Andy Zeng, Angel X. Chang, Manolis Savva, Silvio Savarese, Thomas Funkhouser

We present Im2Pano3D, a convolutional neural network that generates a dense prediction of 3D structure and a probability distribution of semantic labels for a full 360 panoramic view of an indoor scene when given only a partial observation ( <=50%) in the form of an RGB-D image.

Im2Pano3D: Extrapolating 360 Structure and Semantics Beyond the Field of View

no code implementations12 Dec 2017 Shuran Song, Andy Zeng, Angel X. Chang, Manolis Savva, Silvio Savarese, Thomas Funkhouser

We present Im2Pano3D, a convolutional neural network that generates a dense prediction of 3D structure and a probability distribution of semantic labels for a full 360 panoramic view of an indoor scene when given only a partial observation (<= 50%) in the form of an RGB-D image.

MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments

2 code implementations11 Dec 2017 Manolis Savva, Angel X. Chang, Alexey Dosovitskiy, Thomas Funkhouser, Vladlen Koltun

We present MINOS, a simulator designed to support the development of multisensory models for goal-directed navigation in complex indoor environments.

Navigate reinforcement-learning +1

Learning Where to Look: Data-Driven Viewpoint Set Selection for 3D Scenes

no code implementations7 Apr 2017 Kyle Genova, Manolis Savva, Angel X. Chang, Thomas Funkhouser

We provide a search algorithm that generates a sampling of likely candidate views according to the example distribution, and a set selection algorithm that chooses a subset of the candidates that jointly cover the example distribution.

Segmentation Semantic Segmentation

SceneSeer: 3D Scene Design with Natural Language

no code implementations28 Feb 2017 Angel X. Chang, Mihail Eric, Manolis Savva, Christopher D. Manning

We present SceneSeer: an interactive text to 3D scene generation system that allows a user to design 3D scenes using natural language.

Scene Generation Text to 3D

SceneSuggest: Context-driven 3D Scene Design

no code implementations28 Feb 2017 Manolis Savva, Angel X. Chang, Maneesh Agrawala

We present SceneSuggest: an interactive 3D scene design system providing context-driven suggestions for 3D model retrieval and placement.

Graphics Human-Computer Interaction

Semantic Scene Completion from a Single Depth Image

3 code implementations CVPR 2017 Shuran Song, Fisher Yu, Andy Zeng, Angel X. Chang, Manolis Savva, Thomas Funkhouser

This paper focuses on semantic scene completion, a task for producing a complete 3D voxel representation of volumetric occupancy and semantic labels for a scene from a single-view depth map observation.

3D Semantic Scene Completion

Evaluating the word-expert approach for Named-Entity Disambiguation

no code implementations15 Mar 2016 Angel X. Chang, Valentin I. Spitkovsky, Christopher D. Manning, Eneko Agirre

Named Entity Disambiguation (NED) is the task of linking a named-entity mention to an instance in a knowledge-base, typically Wikipedia.

Entity Disambiguation Word Sense Disambiguation

Cannot find the paper you are looking for? You can Submit a new open access paper.