Search Results for author: Vitor Guizilini

Found 23 papers, 10 papers with code

Multi-Frame Self-Supervised Depth with Transformers

no code implementations15 Apr 2022 Vitor Guizilini, Rares Ambrus, Dian Chen, Sergey Zakharov, Adrien Gaidon

Experiments on the KITTI and DDAD datasets show that our DepthFormer architecture establishes a new state of the art in self-supervised monocular depth estimation, and is even competitive with highly specialized supervised single-frame architectures.

Frame Monocular Depth Estimation

Learning Optical Flow, Depth, and Scene Flow without Real-World Labels

no code implementations28 Mar 2022 Vitor Guizilini, Kuan-Hui Lee, Rares Ambrus, Adrien Gaidon

However, the simultaneous self-supervised learning of depth and scene flow is ill-posed, as there are infinitely many combinations that result in the same 3D point.

Autonomous Driving Monocular Depth Estimation +3

Self-Supervised Camera Self-Calibration from Video

no code implementations6 Dec 2021 Jiading Fang, Igor Vasiljevic, Vitor Guizilini, Rares Ambrus, Greg Shakhnarovich, Adrien Gaidon, Matthew R. Walter

Camera calibration is integral to robotics and computer vision algorithms that seek to infer geometric properties of the scene from visual input streams.

Autonomous Vehicles Camera Calibration +3

DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries

1 code implementation13 Oct 2021 Yue Wang, Vitor Guizilini, Tianyuan Zhang, Yilun Wang, Hang Zhao, Justin Solomon

This top-down approach outperforms its bottom-up counterpart in which object bounding box prediction follows per-pixel depth estimation, since it does not suffer from the compounding error introduced by a depth prediction model.

3D Object Detection Autonomous Driving +1

Is Pseudo-Lidar needed for Monocular 3D Object detection?

1 code implementation ICCV 2021 Dennis Park, Rares Ambrus, Vitor Guizilini, Jie Li, Adrien Gaidon

Recent progress in 3D object detection from single images leverages monocular depth estimation as a way to produce 3D pointclouds, turning cameras into pseudo-lidar sensors.

 Ranked #1 on Monocular 3D Object Detection on KITTI Pedestrian Hard (using extra training data)

Monocular 3D Object Detection Monocular Depth Estimation +1

MarioNette: Self-Supervised Sprite Learning

1 code implementation NeurIPS 2021 Dmitriy Smirnov, Michael Gharbi, Matthew Fisher, Vitor Guizilini, Alexei A. Efros, Justin Solomon

Artists and video game designers often construct 2D animations using libraries of sprites -- textured patches of objects and characters.

Full Surround Monodepth from Multiple Cameras

no code implementations31 Mar 2021 Vitor Guizilini, Igor Vasiljevic, Rares Ambrus, Greg Shakhnarovich, Adrien Gaidon

In this work, we extend monocular self-supervised depth and ego-motion estimation to large-baseline multi-camera rigs.

Autonomous Driving Motion Estimation

Geometric Unsupervised Domain Adaptation for Semantic Segmentation

no code implementations ICCV 2021 Vitor Guizilini, Jie Li, Rares Ambrus, Adrien Gaidon

Simulators can efficiently generate large amounts of labeled synthetic data with perfect supervision for hard-to-label tasks like semantic segmentation.

Monocular Depth Estimation Semantic Segmentation +1

Monocular Depth Estimation for Soft Visuotactile Sensors

no code implementations5 Jan 2021 Rares Ambrus, Vitor Guizilini, Naveen Kuppuswamy, Andrew Beaulieu, Adrien Gaidon, Alex Alspach

Fluid-filled soft visuotactile sensors such as the Soft-bubbles alleviate key challenges for robust manipulation, as they enable reliable grasps along with the ability to obtain high-resolution sensory feedback on contact geometry and forces.

Monocular Depth Estimation

Neural Ray Surfaces for Self-Supervised Learning of Depth and Ego-motion

1 code implementation15 Aug 2020 Igor Vasiljevic, Vitor Guizilini, Rares Ambrus, Sudeep Pillai, Wolfram Burgard, Greg Shakhnarovich, Adrien Gaidon

Self-supervised learning has emerged as a powerful tool for depth and ego-motion estimation, leading to state-of-the-art results on benchmark datasets.

Depth Estimation Motion Estimation +2

Semantically-Guided Representation Learning for Self-Supervised Monocular Depth

1 code implementation ICLR 2020 Vitor Guizilini, Rui Hou, Jie Li, Rares Ambrus, Adrien Gaidon

Instead of using semantic labels and proxy losses in a multi-task approach, we propose a new architecture leveraging fixed pretrained semantic segmentation networks to guide self-supervised representation learning via pixel-adaptive convolutions.

Monocular Depth Estimation Representation Learning +2

Neural Outlier Rejection for Self-Supervised Keypoint Learning

2 code implementations ICLR 2020 Jiexiong Tang, Hanme Kim, Vitor Guizilini, Sudeep Pillai, Rares Ambrus

By making the sampling of inlier-outlier sets from point-pair correspondences fully differentiable within the keypoint learning framework, we show that are able to simultaneously self-supervise keypoint description and improve keypoint matching.

Homography Estimation Keypoint Detection +1

Dynamic Hilbert Maps: Real-Time Occupancy Predictions in Changing Environment

no code implementations4 Dec 2019 Vitor Guizilini, Ransalu Senanayake, Fabio Ramos

This paper addresses the problem of learning instantaneous occupancy levels of dynamic environments and predicting future occupancy levels.

Two Stream Networks for Self-Supervised Ego-Motion Estimation

no code implementations4 Oct 2019 Rares Ambrus, Vitor Guizilini, Jie Li, Sudeep Pillai, Adrien Gaidon

Learning depth and camera ego-motion from raw unlabeled RGB video streams is seeing exciting progress through self-supervision from strong geometric cues.

Data Augmentation Motion Estimation +1

Robust Semi-Supervised Monocular Depth Estimation with Reprojected Distances

no code implementations4 Oct 2019 Vitor Guizilini, Jie Li, Rares Ambrus, Sudeep Pillai, Adrien Gaidon

Dense depth estimation from a single image is a key problem in computer vision, with exciting applications in a multitude of robotic tasks.

Monocular Depth Estimation

Sparse-to-Continuous: Enhancing Monocular Depth Estimation using Occupancy Maps

1 code implementation24 Sep 2018 Nícolas Rosa, Vitor Guizilini, Valdir Grassi Jr

This paper addresses the problem of single image depth estimation (SIDE), focusing on improving the quality of deep neural network predictions.

Monocular Depth Estimation

Learning to Race through Coordinate Descent Bayesian Optimisation

no code implementations17 Feb 2018 Rafael Oliveira, Fernando H. M. Rocha, Lionel Ott, Vitor Guizilini, Fabio Ramos, Valdir Grassi Jr

On the other hand, the cost to evaluate the policy's performance might also be high, being desirable that a solution can be found with as few interactions as possible with the real system.

Bayesian Optimisation Car Racing

Continuous Convolutional Neural Networks for Image Classification

no code implementations ICLR 2018 Vitor Guizilini, Fabio Ramos

This paper introduces the concept of continuous convolution to neural networks and deep learning applications in general.

Classification General Classification +1

Bayesian Optimisation for Safe Navigation under Localisation Uncertainty

no code implementations7 Sep 2017 Rafael Oliveira, Lionel Ott, Vitor Guizilini, Fabio Ramos

In outdoor environments, mobile robots are required to navigate through terrain with varying characteristics, some of which might significantly affect the integrity of the platform.

Bayesian Optimisation

Cannot find the paper you are looking for? You can Submit a new open access paper.