Search Results for author: Congyue Deng

Found 15 papers, 5 papers with code

PhysPart: Physically Plausible Part Completion for Interactable Objects

no code implementations25 Aug 2024 Rundong Luo, Haoran Geng, Congyue Deng, Puhao Li, Zan Wang, Baoxiong Jia, Leonidas Guibas, Siyuan Huang

We also demonstrate our applications in 3D printing, robot manipulation, and sequential part generation, showing our strength in realistic tasks with the demand for high physical plausibility.

Robot Manipulation

RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation

1 code implementation5 Jul 2024 Yuxuan Kuang, Junjie Ye, Haoran Geng, Jiageng Mao, Congyue Deng, Leonidas Guibas, He Wang, Yue Wang

First, RAM extracts unified affordance at scale from diverse sources of demonstrations including robotic data, human-object interaction (HOI) data, and custom data to construct a comprehensive affordance memory.

Human-Object Interaction Detection Retrieval

EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learning

no code implementations1 Jul 2024 Jingyun Yang, Zi-ang Cao, Congyue Deng, Rika Antonova, Shuran Song, Jeannette Bohg

Building effective imitation learning methods that enable robots to learn from limited data and still generalize across diverse real-world environments is a long-standing problem in robot learning.

Imitation Learning Robot Manipulation

Zero-Shot Image Feature Consensus with Deep Functional Maps

no code implementations18 Mar 2024 Xinle Cheng, Congyue Deng, Adam Harley, Yixin Zhu, Leonidas Guibas

We demonstrate that our technique yields correspondences that are not only smoother but also more accurate, with the possibility of better reflecting the knowledge embedded in the large-scale vision models that we are studying.

Denoising Vision Transformers

1 code implementation5 Jan 2024 Jiawei Yang, Katie Z Luo, Jiefeng Li, Congyue Deng, Leonidas Guibas, Dilip Krishnan, Kilian Q Weinberger, Yonglong Tian, Yue Wang

In the second stage, we train a lightweight transformer block to predict clean features from raw ViT outputs, leveraging the derived estimates of the clean features as supervision.

Denoising Depth Estimation +3

SAGE: Bridging Semantic and Actionable Parts for GEneralizable Manipulation of Articulated Objects

no code implementations3 Dec 2023 Haoran Geng, Songlin Wei, Congyue Deng, Bokui Shen, He Wang, Leonidas Guibas

More concretely, given an articulated object, we first observe all the semantic parts on it, conditioned on which an instruction interpreter proposes possible action programs that concretize the natural language instruction.

Language Modelling Object

Rethinking Directional Integration in Neural Radiance Fields

no code implementations28 Nov 2023 Congyue Deng, Jiawei Yang, Leonidas Guibas, Yue Wang

To that end, we introduce a modification to the NeRF rendering equation which is as simple as a few lines of code change for any NeRF variations, while greatly improving the rendering quality of view-dependent effects.

3D Reconstruction Decoder +3

Make a Donut: Hierarchical EMD-Space Planning for Zero-Shot Deformable Manipulation with Tools

no code implementations5 Nov 2023 Yang You, Bokui Shen, Congyue Deng, Haoran Geng, Songlin Wei, He Wang, Leonidas Guibas

Remarkably, our model demonstrates robust generalization capabilities to novel and previously unencountered complex tasks without any preliminary demonstrations.

Deformable Object Manipulation Model Predictive Control

SparseDFF: Sparse-View Feature Distillation for One-Shot Dexterous Manipulation

no code implementations25 Oct 2023 Qianxu Wang, Haotong Zhang, Congyue Deng, Yang You, Hao Dong, Yixin Zhu, Leonidas Guibas

Central to SparseDFF is a feature refinement network, optimized with a contrastive loss between views and a point-pruning mechanism for feature continuity.

One-Shot Learning

NAP: Neural 3D Articulation Prior

1 code implementation25 May 2023 Jiahui Lei, Congyue Deng, Bokui Shen, Leonidas Guibas, Kostas Daniilidis

We propose Neural 3D Articulation Prior (NAP), the first 3D deep generative model to synthesize 3D articulated object models.

3D Generation Denoising +2

NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors

1 code implementation CVPR 2023 Congyue Deng, Chiyu "Max'' Jiang, Charles R. Qi, Xinchen Yan, Yin Zhou, Leonidas Guibas, Dragomir Anguelov

Formulating single-view reconstruction as an image-conditioned 3D generation problem, we optimize the NeRF representations by minimizing a diffusion loss on its arbitrary view renderings with a pretrained image diffusion model under the input-view constraint.

3D Generation 3D geometry +1

Breaking the Symmetry: Resolving Symmetry Ambiguities in Equivariant Neural Networks

no code implementations29 Oct 2022 Sidhika Balachandar, Adrien Poulenard, Congyue Deng, Leonidas Guibas

We present OAVNN: Orientation Aware Vector Neuron Network, an extension of the Vector Neuron Network.

Vector Neurons: A General Framework for SO(3)-Equivariant Networks

4 code implementations ICCV 2021 Congyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard, Andrea Tagliasacchi, Leonidas Guibas

Invariance and equivariance to the rotation group have been widely discussed in the 3D deep learning community for pointclouds.

Alternating ConvLSTM: Learning Force Propagation with Alternate State Updates

no code implementations14 Jun 2020 Congyue Deng, Tai-Jiang Mu, Shi-Min Hu

Experimental results show that Alt-ConvLSTM efficiently models the material kinetic features and greatly outperforms vanilla ConvLSTM with only the single state update.

Cannot find the paper you are looking for? You can Submit a new open access paper.