Visual Navigation
State-of-the-art leaderboards
Greatest papers with code
Visual Representations for Semantic Target Driven Navigation
We propose to using high level semantic and contextual features including segmentation and detection masks obtained by off-the-shelf state-of-the-art vision as observations and use deep network to learn the navigation policy.
Cognitive Mapping and Planning for Visual Navigation
CVPR 2017
• tensorflow/models
• 
The accumulated belief of the world enables the agent to track visited regions of the environment.
The Regretful Navigation Agent for Vision-and-Language Navigation
CVPR 2019 (Oral) 2019
• chihyaoma/regretful-agent
• 
As deep learning continues to make progress for challenging perception tasks, there is increased interest in combining vision, language, and decision-making.
DECISION MAKING PERCEPTION VISION-LANGUAGE NAVIGATION VISUAL NAVIGATION
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation
As deep learning continues to make progress for challenging perception tasks, there is increased interest in combining vision, language, and decision-making.
DECISION MAKING PERCEPTION VISION-LANGUAGE NAVIGATION VISUAL NAVIGATION
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
ICLR 2019
• chihyaoma/selfmonitoring-agent
•
The Vision-and-Language Navigation (VLN) task entails an agent following navigational instruction in photo-realistic unknown environments.
NATURAL LANGUAGE VISUAL GROUNDING VISION-LANGUAGE NAVIGATION VISUAL NAVIGATION
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning
In this paper we study the problem of learning to learn at both training and test time in the context of visual navigation.
An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVs
Nano-size unmanned aerial vehicles (UAVs), with few centimeters of diameter and sub-10 Watts of total power budget, have so far been considered incapable of running sophisticated visual-based autonomous navigation software without external aid from base-stations, ad-hoc local positioning infrastructure, and powerful external computation servers.
A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones
As part of our general methodology we discuss the software mapping techniques that enable the state-of-the-art deep convolutional neural network presented in [1] to be fully executed on-board within a strict 6 fps real-time constraint with no compromise in terms of flight results, while all processing is done with only 64 mW on average.
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
• shamanez/Target-Driven-Visual-Navigation-with-Distributed-PPO
•
To address the second issue, we propose AI2-THOR framework, which provides an environment with high-quality 3D scenes and physics engine.