no code implementations • 20 May 2024 • Fotios Logothetis, Ignas Budvytis, Roberto Cipolla
In this work we present a novel multi-view photometric stereo (MVPS) method.
1 code implementation • 14 Apr 2024 • Fei Xue, Ignas Budvytis, Daniel Olmeda Reino, Roberto Cipolla
However, in spite of high efficiency, APRs and SCRs have limited accuracy especially in large-scale outdoor scenes; HMs are accurate but need to store a large number of 2D descriptors for matching, resulting in poor efficiency.
1 code implementation • 11 Apr 2024 • Fei Xue, Ignas Budvytis, Roberto Cipolla
Humans localize themselves efficiently in known environments by first recognizing landmarks defined on certain objects and their spatial relationships, and then verifying the location by aligning detailed structures of recognized objects with those in the memory.
no code implementations • 3 Apr 2024 • Sahil J. Sindhi, Ignas Budvytis
Third, the observation that the main missing component in developing a truly generalised network is an efficient approach for self-consistent input of previously learnt sub-steps of an algorithm and their (implicit) composition during the network's internal forward pass.
no code implementations • CVPR 2024 • Chao Zhang, Mohan Li, Ignas Budvytis, Stephan Liwicki
However, most existing works in embodied dialog research focus on navigation and leave the localization task understudied.
no code implementations • 27 Nov 2023 • Patrick Hajali, Ignas Budvytis
Generating computer programs in general-purpose programming languages like Python poses a challenge for LLMs when instructed to use code provided in the prompt.
no code implementations • 10 Nov 2023 • Fotios Logothetis, Ignas Budvytis, Roberto Cipolla
As in recent neural multi-view shape estimation frameworks such as NeRF, SIREN and inverse graphics approaches to multi-view photometric stereo (e. g. PS-NeRF) we formulate shape estimation task as learning of a differentiable surface and texture representation by minimising surface normal discrepancy for normals estimated from multiple varying light images for two views as well as discrepancy between rendered surface intensity and observed images.
no code implementations • 17 Oct 2023 • Florian Langer, Ignas Budvytis, Roberto Cipolla
Introducing a new network architecture Multi-SPARC we learn to perform CAD model alignments for multiple detected objects jointly.
1 code implementation • CVPR 2023 • Akash Sengupta, Ignas Budvytis, Roberto Cipolla
Monocular 3D human pose and shape estimation is an ill-posed problem since multiple 3D solutions can explain a 2D image of a subject.
Ranked #9 on Multi-Hypotheses 3D Human Pose Estimation on AH36M
1 code implementation • CVPR 2023 • Fei Xue, Ignas Budvytis, Roberto Cipolla
Visual localization is a fundamental task for various applications including autonomous driving and robotics.
1 code implementation • CVPR 2023 • Fei Xue, Ignas Budvytis, Roberto Cipolla
Previous methods solve feature matching and pose estimation using a two-stage process by first finding matches and then estimating the pose.
no code implementations • 10 Oct 2022 • Fotios Logothetis, Roberto Mecca, Ignas Budvytis, Roberto Cipolla
Reconstructing the 3D shape of an object using several images under different light sources is a very challenging task, especially when realistic assumptions such as light propagation and attenuation, perspective viewing geometry and specular light reflection are considered.
1 code implementation • 7 Oct 2022 • Gwangbin Bae, Ignas Budvytis, Roberto Cipolla
The depth of each pixel can be propagated to a query pixel, using the predicted surface normal as guidance.
Ranked #42 on Monocular Depth Estimation on NYU-Depth V2
1 code implementation • 3 Oct 2022 • Florian Langer, Gwangbin Bae, Ignas Budvytis, Roberto Cipolla
This combined information is the input to a pose prediction network, SPARC-Net which we train to predict a 9 DoF CAD model pose update.
no code implementations • CVPR 2022 • Fei Xue, Ignas Budvytis, Daniel Olmeda Reino, Roberto Cipolla
Hierarchical frameworks consisting of both coarse and fine localization are often used as the standard pipeline for large-scale visual localization.
1 code implementation • CVPR 2022 • Gwangbin Bae, Ignas Budvytis, Roberto Cipolla
To this end, we propose MaGNet, a novel framework for fusing single-view depth probability with multi-view geometry, to improve the accuracy, robustness and efficiency of multi-view depth estimation.
no code implementations • 30 Nov 2021 • Akash Sengupta, Ignas Budvytis, Roberto Cipolla
This paper addresses the problem of 3D human body shape and pose estimation from RGB images.
1 code implementation • 10 Nov 2021 • Florian Langer, Ignas Budvytis, Roberto Cipolla
In this work we demonstrate how cross-domain keypoint matches from an RGB image to a rendered CAD model allow for more precise object pose predictions compared to ones obtained through direct predictions.
1 code implementation • ICCV 2021 • Akash Sengupta, Ignas Budvytis, Roberto Cipolla
Thus, it is desirable to estimate a distribution over 3D body shape and pose conditioned on the input image instead of a single 3D reconstruction.
Ranked #1 on 3D Human Shape Estimation on SSP-3D
1 code implementation • ICCV 2021 • Gwangbin Bae, Ignas Budvytis, Roberto Cipolla
Experimental results show that the proposed method outperforms the state-of-the-art in ScanNet and NYUv2, and that the estimated uncertainty correlates well with the prediction error.
Ranked #1 on Surface Normal Estimation on NYU-Depth V2
no code implementations • 27 Apr 2021 • Roberto Mecca, Fotios Logothetis, Ignas Budvytis, Roberto Cipolla
In order to fill the gap in evaluating near-field photometric stereo methods, we introduce LUCES the first real-world 'dataset for near-fieLd point light soUrCe photomEtric Stereo' of 14 objects of a varying of materials.
no code implementations • CVPR 2021 • Akash Sengupta, Ignas Budvytis, Roberto Cipolla
In contrast, we propose a new task: shape and pose estimation from a group of multiple images of a human subject, without constraints on subject pose, camera viewpoint or background conditions between images in the group.
Ranked #3 on 3D Human Shape Estimation on SSP-3D
3D Human Shape Estimation Multi-Hypotheses 3D Human Pose Estimation +1
1 code implementation • 21 Sep 2020 • Akash Sengupta, Ignas Budvytis, Roberto Cipolla
Thus, we propose STRAPS (Synthetic Training for Real Accurate Pose and Shape), a system that utilises proxy representations, such as silhouettes and 2D joints, as inputs to a shape and pose regression neural network, which is trained with synthetic training data (generated on-the-fly during training using the SMPL statistical body model) to overcome data scarcity.
Ranked #1 on 3D Human Shape Estimation on MoVi
3D human pose and shape estimation 3D Human Shape Estimation +3
no code implementations • 12 Sep 2020 • Fotios Logothetis, Ignas Budvytis, Roberto Mecca, Roberto Cipolla
Secondly, we compute the depth by integrating the normal field in order to iteratively estimate light directions and attenuation which is used to compensate the input images to compute reflectance samples for the next iteration.
no code implementations • ICCV 2021 • Fotios Logothetis, Ignas Budvytis, Roberto Mecca, Roberto Cipolla
We show that global physical effects can be approximated on the observation map domain and this simplifies and speeds up the data creation procedure.
no code implementations • 23 Sep 2019 • Ignas Budvytis, Marvin Teichmann, Tomas Vojir, Roberto Cipolla
We obtain smaller mean distance and angular errors than state-of-the-art 6-DoF pose estimation algorithms based on direct pose regression and pose estimation from scene coordinates on all datasets.