Search Results for author: Yinyu Nie

Found 18 papers, 7 papers with code

GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond

1 code implementation28 Mar 2024 Chongjie Ye, Yinyu Nie, Jiahao Chang, Yuantao Chen, YiHao Zhi, Xiaoguang Han

We present GauStudio, a novel modular framework for modeling 3D Gaussian Splatting (3DGS) to provide standardized, plug-and-play components for users to easily customize and implement a 3DGS pipeline.

Novel View Synthesis Surface Reconstruction

Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation

no code implementations28 Mar 2024 Yujin Chen, Yinyu Nie, Benjamin Ummenhofer, Reiner Birkl, Michael Paulitsch, Matthias Müller, Matthias Nießner

In Mesh2NeRF, we propose an analytic solution to directly obtain ground-truth radiance fields from 3D meshes, characterizing the density field with an occupancy function featuring a defined surface thickness, and determining view-dependent color through a reflection function considering both the mesh and environment lighting.

3D Generation

LASA: Instance Reconstruction from Real Scans using A Large-scale Aligned Shape Annotation Dataset

no code implementations19 Dec 2023 Haolin Liu, Chongjie Ye, Yinyu Nie, Yingfan He, Xiaoguang Han

Instance shape reconstruction from a 3D scene involves recovering the full geometries of multiple objects at the semantic instance level.

3D Object Detection Object +1

HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting

no code implementations5 Dec 2023 Helisa Dhamo, Yinyu Nie, Arthur Moreau, Jifei Song, Richard Shaw, Yiren Zhou, Eduardo Pérez-Pellitero

3D head animation has seen major quality and runtime improvements over the last few years, particularly empowered by the advances in differentiable rendering and neural radiance fields.

DPHMs: Diffusion Parametric Head Models for Depth-based Tracking

no code implementations2 Dec 2023 Jiapeng Tang, Angela Dai, Yinyu Nie, Lev Markhasin, Justus Thies, Matthias Niessner

We introduce Diffusion Parametric Head Models (DPHMs), a generative model that enables robust volumetric head reconstruction and tracking from monocular depth sequences.

3D Scene Diffusion Guidance using Scene Graphs

no code implementations8 Aug 2023 Mohammad Naanaa, Katharina Schmid, Yinyu Nie

Guided synthesis of high-quality 3D scenes is a challenging task.

Denoising

NerVE: Neural Volumetric Edges for Parametric Curve Extraction from Point Cloud

no code implementations CVPR 2023 Xiangyu Zhu, Dong Du, Weikai Chen, Zhiyou Zhao, Yinyu Nie, Xiaoguang Han

We show that a simple network based on NerVE can already outperform the previous state-of-the-art methods by a great margin.

Keypoint Detection

DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis

no code implementations24 Mar 2023 Jiapeng Tang, Yinyu Nie, Lev Markhasin, Angela Dai, Justus Thies, Matthias Nießner

We introduce a diffusion network to synthesize a collection of 3D indoor objects by denoising a set of unordered object attributes.

Denoising Indoor Scene Synthesis +1

Learning 3D Scene Priors with 2D Supervision

no code implementations CVPR 2023 Yinyu Nie, Angela Dai, Xiaoguang Han, Matthias Nießner

Holistic 3D scene understanding entails estimation of both layout configuration and object geometry in a 3D environment.

Scene Understanding

PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categories

1 code implementation10 Jun 2022 Yuchen Rao, Yinyu Nie, Angela Dai

While 3D shape representations enable powerful reasoning in many visual and perception applications, learning 3D shape priors tends to be constrained to the specific categories trained on, leading to an inefficient learning process, particularly for general applications with unseen categories.

Pose2Room: Understanding 3D Scenes from Human Activities

no code implementations1 Dec 2021 Yinyu Nie, Angela Dai, Xiaoguang Han, Matthias Nießner

To this end, we propose P2R-Net to learn a probabilistic 3D model of the objects in a scene characterized by their class categories and oriented 3D bounding boxes, based on an input observed human trajectory in the environment.

Object

ME-PCN: Point Completion Conditioned on Mask Emptiness

1 code implementation ICCV 2021 Bingchen Gong, Yinyu Nie, Yiqun Lin, Xiaoguang Han, Yizhou Yu

Main-stream methods predict the missing shapes by decoding a global feature learned from the input point cloud, which often leads to deficient results in preserving topology consistency and surface details.

Surgical Instruction Generation with Transformers

1 code implementation14 Jul 2021 Jinglu Zhang, Yinyu Nie, Jian Chang, Jian Jun Zhang

Automatic surgical instruction generation is a prerequisite towards intra-operative context-aware surgical assistance.

Machine Translation Reinforcement Learning (RL) +1

RfD-Net: Point Scene Understanding by Semantic Instance Reconstruction

1 code implementation CVPR 2021 Yinyu Nie, Ji Hou, Xiaoguang Han, Matthias Nießner

In this work, we introduce RfD-Net that jointly detects and reconstructs dense object surfaces directly from raw point clouds.

Object object-detection +4

Symmetric Dilated Convolution for Surgical Gesture Recognition

1 code implementation13 Jul 2020 Jinglu Zhang, Yinyu Nie, Yao Lyu, Hailin Li, Jian Chang, Xiaosong Yang, Jian Jun Zhang

The experiment results demonstrate the ability of our method on capturing long-term frame dependencies, which largely outperform the state-of-the-art methods on the frame-wise accuracy up to ~6 points and the F1@50 score ~6 points.

Gesture Recognition Surgical Gesture Recognition

Shallow2Deep: Indoor Scene Modeling by Single Image Understanding

no code implementations22 Feb 2020 Yinyu Nie, Shihui Guo, Jian Chang, Xiaoguang Han, Jiahui Huang, Shi-Min Hu, Jian Jun Zhang

Particularly, we design a shallow-to-deep architecture on the basis of convolutional networks for semantic scene understanding and modeling.

Relation Network Scene Understanding

Cannot find the paper you are looking for? You can Submit a new open access paper.