GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

1 code implementation • 21 Mar 2024 • Yinghao Xu, Zifan Shi, Wang Yifan, Hansheng Chen, Ceyuan Yang, Sida Peng, Yujun Shen, Gordon Wetzstein

We introduce GRM, a large-scale reconstructor capable of recovering a 3D asset from sparse-view images in around 0. 1s.

3D Reconstruction Image to 3D +1

Generic 3D Diffusion Adapter Using Controlled Multi-View Editing

1 code implementation • 18 Mar 2024 • Hansheng Chen, Ruoxi Shi, Yulin Liu, Bokui Shen, Jiayuan Gu, Gordon Wetzstein, Hao Su, Leonidas Guibas

Open-domain 3D object synthesis has been lagging behind image synthesis due to limited data and higher computational complexity.

3D Generation Image to 3D +2

DiffusionRegPose: Enhancing Multi-Person Pose Estimation using a Diffusion-Based End-to-End Regression Approach

no code implementations • CVPR 2024 • Dayi Tan, Hansheng Chen, Wei Tian, Lu Xiong

This paper presents the DiffusionRegPose a novel approach to multi-person pose estimation that converts a one-stage end-to-end keypoint regression model into a diffusion-based sampling process.

Multi-Person Pose Estimation regression

One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion

no code implementations • CVPR 2024 • Minghua Liu, Ruoxi Shi, Linghao Chen, Zhuoyang Zhang, Chao Xu, Xinyue Wei, Hansheng Chen, Chong Zeng, Jiayuan Gu, Hao Su

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts.

Image Generation Image to 3D +1

Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model

1 code implementation • 23 Oct 2023 • Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, Hao Su

We report Zero123++, an image-conditioned diffusion model for generating 3D-consistent multi-view images from a single input view.

Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction

1 code implementation • ICCV 2023 • Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images.

3D-Aware Image Synthesis 3D Generation +4

EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation

2 code implementations • 22 Mar 2023 • Hansheng Chen, Wei Tian, Pichao Wang, Fan Wang, Lu Xiong, Hao Li

In this paper, we propose the EPro-PnP, a probabilistic PnP layer for general end-to-end pose estimation, which outputs a distribution of pose with differentiable probability density on the SE(3) manifold.

3D Object Detection 6D Pose Estimation using RGB +1

EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation

1 code implementation • CVPR 2022 • Hansheng Chen, Pichao Wang, Fan Wang, Wei Tian, Lu Xiong, Hao Li

The 2D-3D coordinates and corresponding weights are treated as intermediate variables learned by minimizing the KL divergence between the predicted and target pose distribution.

3D Object Detection 6D Pose Estimation using RGB +1

MonoRUn: Monocular 3D Object Detection by Reconstruction and Uncertainty Propagation

1 code implementation • CVPR 2021 • Hansheng Chen, Yuyao Huang, Wei Tian, Zhong Gao, Lu Xiong

To regress the pixel-related 3D object coordinates, we employ a regional reconstruction network with uncertainty awareness.

Monocular 3D Object Detection Object +3

SPFCN: Select and Prune the Fully Convolutional Networks for Real-time Parking Slot Detection

1 code implementation • 25 Mar 2020 • Zhuoping Yu, Zhong Gao, Hansheng Chen, Yuyao Huang

For vehicles equipped with the automatic parking system, the accuracy and speed of the parking slot detection are crucial.