Search Results for author: Shengyu Huang

Found 14 papers, 5 papers with code

Living Scenes: Multi-object Relocalization and Reconstruction in Changing 3D Environments

no code implementations14 Dec 2023 Liyuan Zhu, Shengyu Huang, Konrad Schindler, Iro Armeni

Research into dynamic 3D scene understanding has primarily focused on short-term change tracking from dense observations, while little attention has been paid to long-term changes with sparse observations.

3D Reconstruction Scene Understanding

Dynamic LiDAR Re-simulation using Compositional Neural Fields

no code implementations8 Dec 2023 Hanfeng Wu, Xingxing Zuo, Stefan Leutenegger, Or Litany, Konrad Schindler, Shengyu Huang

We introduce DyNFL, a novel neural field-based approach for high-fidelity re-simulation of LiDAR scans in dynamic driving scenes.

DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control

no code implementations5 Dec 2023 Yuru Jia, Lukas Hoyer, Shengyu Huang, Tianfu Wang, Luc van Gool, Konrad Schindler, Anton Obukhov

Large, pretrained latent diffusion models (LDMs) have demonstrated an extraordinary ability to generate creative content, specialize to user data through few-shot fine-tuning, and condition their output on other modalities, such as semantic maps.

Autonomous Driving Domain Generalization +1

Nothing Stands Still: A Spatiotemporal Benchmark on 3D Point Cloud Registration Under Large Geometric and Temporal Change

no code implementations15 Nov 2023 Tao Sun, Yan Hao, Shengyu Huang, Silvio Savarese, Konrad Schindler, Marc Pollefeys, Iro Armeni

To this end, we introduce the Nothing Stands Still (NSS) benchmark, which focuses on the spatiotemporal registration of 3D scenes undergoing large spatial and temporal change, ultimately creating one coherent spatiotemporal map.

Point Cloud Registration

Towards the Better Ranking Consistency: A Multi-task Learning Framework for Early Stage Ads Ranking

no code implementations12 Jul 2023 Xuewei Wang, Qiang Jin, Shengyu Huang, Min Zhang, Xi Liu, Zhengli Zhao, Yukun Chen, Zhengyu Zhang, Jiyan Yang, Ellie Wen, Sagar Chordia, Wenlin Chen, Qin Huang

In order to pass better ads from the early to the final stage ranking, we propose a multi-task learning framework for early stage ranking to capture multiple final stage ranking components (i. e. ads clicks and ads quality events) and their task relations.

Multi-Task Learning

Neural LiDAR Fields for Novel View Synthesis

no code implementations ICCV 2023 Shengyu Huang, Zan Gojcic, Zian Wang, Francis Williams, Yoni Kasten, Sanja Fidler, Konrad Schindler, Or Litany

We present Neural Fields for LiDAR (NFL), a method to optimise a neural field scene representation from LiDAR measurements, with the goal of synthesizing realistic LiDAR scans from novel viewpoints.

Novel LiDAR View Synthesis Semantic Segmentation

Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes

no code implementations6 Apr 2023 Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang, Jacob Munkberg, Jon Hasselgren, Zan Gojcic, Wenzheng Chen, Sanja Fidler

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion.

3D Reconstruction Inverse Rendering

DEFLOW: Self-supervised 3D Motion Estimation of Debris Flow

no code implementations5 Apr 2023 Liyuan Zhu, Yuru Jia, Shengyu Huang, Nicholas Meyer, Andreas Wieser, Konrad Schindler, Jordan Aaron

Our model achieves state-of-the-art optical flow and depth estimation on our dataset, and fully automates the motion estimation for debris flows.

Autonomous Driving Depth Estimation +4

Dynamic 3D Scene Analysis by Point Cloud Accumulation

1 code implementation25 Jul 2022 Shengyu Huang, Zan Gojcic, Jiahui Huang, Andreas Wieser, Konrad Schindler

Compared to state-of-the-art scene flow estimators, our proposed approach aims to align all 3D points in a common reference frame correctly accumulating the points on the individual objects.

Autonomous Vehicles Semantic Segmentation +1

ImpliCity: City Modeling from Satellite Images with Deep Implicit Occupancy Fields

1 code implementation24 Jan 2022 Corinne Stucker, Bingxin Ke, Yuanwen Yue, Shengyu Huang, Iro Armeni, Konrad Schindler

To make full use of the point cloud and the underlying images, we introduce ImpliCity, a neural representation of the 3D scene as an implicit, continuous occupancy field, driven by learned embeddings of the point cloud and a stereo pair of ortho-photos.

Indoor Scene Recognition in 3D

2 code implementations28 Feb 2020 Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler

Moreover, we advocate multi-task learning as a way of improving scene recognition, building on the fact that the scene type is highly correlated with the objects in the scene, and therefore with its semantic segmentation into different object classes.

Multi-Task Learning Scene Recognition +1

Cannot find the paper you are looking for? You can Submit a new open access paper.