no code implementations • 6 Dec 2024 • Cameron Braunstein, Hevra Petekkaya, Jan Eric Lenssen, Mariya Toneva, Eddy Ilg
We introduce SLayR, Scene Layout Generation with Rectified flow.
no code implementations • 29 Aug 2024 • Kevin Raj, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen
We introduce Spurfies, a novel method for sparse-view surface reconstruction that disentangles appearance and geometry information to utilize local geometry priors trained on synthetic data.
1 code implementation • 12 Jul 2024 • Tom Fischer, Yaoyao Liu, Artur Jesslen, Noor Ahmed, Prakhar Kaushik, Angtian Wang, Alan Yuille, Adam Kortylewski, Eddy Ilg
We demonstrate the effectiveness of our method through extensive experiments on the Pascal3D and ObjectNet3D datasets and show that our approach outperforms the baselines for classification by $2-6\%$ in the in-domain and by $6-50\%$ in the OOD setting.
1 code implementation • CVPR 2024 • Leonhard Sommer, Artur Jesslen, Eddy Ilg, Adam Kortylewski
In a second step, the canonical poses and reconstructed meshes enable us to train a model for 3D pose estimation from a single image.
no code implementations • 23 May 2024 • Tom Fischer, Pascal Peter, Joachim Weickert, Eddy Ilg
Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters.
1 code implementation • CVPR 2024 • Jonas Kälble, Sascha Wirges, Maxim Tatarchenko, Eddy Ilg
When converting the occupancy maps back to depth estimates and comparing them with the raw LiDAR measurements, our method yields a MAE improvement of 30% to 52% on nuScenes and 53% on Waymo over other occupancy ground-truth data.
no code implementations • 24 Mar 2024 • Christopher Wewer, Kevin Raj, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen
We present latentSplat, a method to predict semantic Gaussians in a 3D latent space that can be splatted and decoded by a light-weight generative 2D architecture.
no code implementations • 22 Mar 2024 • Raza Yunus, Jan Eric Lenssen, Michael Niemeyer, Yiyi Liao, Christian Rupprecht, Christian Theobalt, Gerard Pons-Moll, Jia-Bin Huang, Vladislav Golyanik, Eddy Ilg
Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision.
no code implementations • 26 Dec 2023 • Cameron Braunstein, Eddy Ilg, Vladislav Golyanik
Our approach is hybrid (i. e., quantum-classical) and is compatible with modern D-Wave quantum annealers, i. e., it includes a quadratic unconstrained binary optimization (QUBO) objective.
1 code implementation • CVPR 2024 • Philipp Schröppel, Christopher Wewer, Jan Eric Lenssen, Eddy Ilg, Thomas Brox
However, none of the existing models enable disentangled generation to control the shape and appearance separately.
no code implementations • CVPR 2024 • Devikalyan Das, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen
However, owing to the ill-posed nature of this problem, there has been no solution that can provide consistent, high-quality novel views from camera positions that are significantly different from the training views.
no code implementations • ICCV 2023 • Christopher Wewer, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen
(1) We design the first neural point representation on a category level by utilizing the concept of coherent point clouds.
4 code implementations • 5 Jun 2022 • Jingyun Liang, Yuchen Fan, Xiaoyu Xiang, Rakesh Ranjan, Eddy Ilg, Simon Green, JieZhang Cao, Kai Zhang, Radu Timofte, Luc van Gool
Specifically, RVRT divides the video into multiple clips and uses the previously inferred clip feature to estimate the subsequent clip feature.
no code implementations • 28 Feb 2022 • Samir Aroudj, Steven Lovegrove, Eddy Ilg, Tanner Schmidt, Michael Goesele, Richard Newcombe
Robustly reconstructing such a volumetric scene model with millions of unknown variables from registered scene images only is a highly non-convex and complex optimization problem.
no code implementations • CVPR 2022 • Tony Ng, Hyo Jin Kim, Vincent Lee, Daniel DeTone, Tsun-Yi Yang, Tianwei Shen, Eddy Ilg, Vassileios Balntas, Krystian Mikolajczyk, Chris Sweeney
We let a feature encoding network and image reconstruction network compete with each other, such that the feature encoder tries to impede the image reconstruction with its generated descriptors, while the reconstructor tries to recover the input image from the descriptors.
no code implementations • 9 May 2021 • Deeksha Dangwal, Vincent T. Lee, Hyo Jin Kim, Tianwei Shen, Meghan Cowan, Rajvi Shah, Caroline Trippel, Brandon Reagen, Timothy Sherwood, Vasileios Balntas, Armin Alaghi, Eddy Ilg
This poses a potential risk to user privacy.
no code implementations • 21 Aug 2020 • Sungyong Baik, Hyo Jin Kim, Tianwei Shen, Eddy Ilg, Kyoung Mu Lee, Chris Sweeney
We tackle the problem of visual localization under changing conditions, such as time of day, weather, and seasons.
no code implementations • 6 Jul 2020 • Wenxin Liu, David Caruso, Eddy Ilg, Jing Dong, Anastasios I. Mourikis, Kostas Daniilidis, Vijay Kumar, Jakob Engel
We show that our network, trained with pedestrian data from a headset, can produce statistically consistent measurement and uncertainty to be used as the update step in the filter, and the tightly-coupled system outperforms velocity integration approaches in position estimates, and AHRS attitude filter in orientation estimates.
1 code implementation • ECCV 2020 • Rohan Chabra, Jan Eric Lenssen, Eddy Ilg, Tanner Schmidt, Julian Straub, Steven Lovegrove, Richard Newcombe
Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception.
1 code implementation • CVPR 2019 • Osama Makansi, Eddy Ilg, Özgün Cicek, Thomas Brox
Future prediction is a fundamental principle of intelligence that helps plan actions and avoid possible dangers.
no code implementations • 20 Aug 2018 • Osama Makansi, Eddy Ilg, Thomas Brox
The latter can be used as proxy-ground-truth to train a network on real-world data and to adapt it to specific domains of interest.
1 code implementation • ECCV 2018 • Eddy Ilg, Tonmoy Saikia, Margret Keuper, Thomas Brox
Making use of the estimated occlusions, we also show improved results on motion segmentation and scene flow estimation.
1 code implementation • ECCV 2018 • Eddy Ilg, Özgün Çiçek, Silvio Galesso, Aaron Klein, Osama Makansi, Frank Hutter, Thomas Brox
Optical flow estimation can be formulated as an end-to-end supervised learning problem, which yields estimates with a superior accuracy-runtime tradeoff compared to alternative methodology.
1 code implementation • 19 Jan 2018 • Nikolaus Mayer, Eddy Ilg, Philipp Fischer, Caner Hazirbas, Daniel Cremers, Alexey Dosovitskiy, Thomas Brox
The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations.
no code implementations • 3 Jul 2017 • Osama Makansi, Eddy Ilg, Thomas Brox
We analyze the usage of optical flow for video super-resolution and find that common off-the-shelf image warping does not allow video super-resolution to benefit much from optical flow.
4 code implementations • 28 Mar 2017 • Anna Khoreva, Rodrigo Benenson, Eddy Ilg, Thomas Brox, Bernt Schiele
Our approach is suitable for both single and multiple object segmentation.
2 code implementations • CVPR 2017 • Benjamin Ummenhofer, Huizhong Zhou, Jonas Uhrig, Nikolaus Mayer, Eddy Ilg, Alexey Dosovitskiy, Thomas Brox
In this paper we formulate structure from motion as a learning problem.
12 code implementations • CVPR 2017 • Eddy Ilg, Nikolaus Mayer, Tonmoy Saikia, Margret Keuper, Alexey Dosovitskiy, Thomas Brox
Particularly on small displacements and real-world data, FlowNet cannot compete with variational methods.
Dense Pixel Correspondence Estimation Optical Flow Estimation +1
3 code implementations • CVPR 2016 • Nikolaus Mayer, Eddy Ilg, Philip Häusser, Philipp Fischer, Daniel Cremers, Alexey Dosovitskiy, Thomas Brox
By combining a flow and disparity estimation network and training it jointly, we demonstrate the first scene flow estimation with a convolutional network.
18 code implementations • ICCV 2015 • Philipp Fischer, Alexey Dosovitskiy, Eddy Ilg, Philip Häusser, Caner Hazırbaş, Vladimir Golkov, Patrick van der Smagt, Daniel Cremers, Thomas Brox
Optical flow estimation has not been among the tasks where CNNs were successful.