About

Visual Navigation is the problem of navigating an agent, e.g. a mobile robot, in an environment using camera input only. The agent is given a target image (an image it will see from the target position), and its goal is to move from its current position to the target by applying a sequence of actions, based on the camera observations only.

Source: Vision-based Navigation Using Deep Reinforcement Learning

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Latest papers with code

Pushing it out of the Way: Interactive Visual Navigation

28 Apr 2021KuoHaoZeng/Interactive_Visual_Navigation

In this paper, we study the problem of interactive navigation where agents learn to change the environment to navigate more efficiently to their goals.

VISUAL NAVIGATION

10
28 Apr 2021

Simultaneous Navigation and Construction Benchmarking Environments

31 Mar 2021ai4ce/SNAC

We need intelligent robots for mobile construction, the process of navigating in an environment and modifying its structure according to a geometric design.

VISUAL NAVIGATION

5
31 Mar 2021

Hierarchical and Partially Observable Goal-driven Policy Learning with Goals Relational Graph

1 Mar 2021Xin-Ye-1/HRL-GRG

We present a novel two-layer hierarchical reinforcement learning approach equipped with a Goals Relational Graph (GRG) for tackling the partially observable goal-driven task, such as goal-driven visual navigation.

HIERARCHICAL REINFORCEMENT LEARNING VISUAL NAVIGATION

2
01 Mar 2021

End-to-End Egospheric Spatial Memory

15 Feb 2021ivy-dl/memory

Spatial memory, or the ability to remember and recall specific locations and objects, is central to autonomous agents' ability to carry out tasks in real environments.

GENERAL REINFORCEMENT LEARNING IMITATION LEARNING ROBOT NAVIGATION SEMANTIC SEGMENTATION VISUAL NAVIGATION

12
15 Feb 2021

On Embodied Visual Navigation in Real Environments Through Habitat

26 Oct 2020rosanom/habitat-domain-adaptation

Visual navigation models based on deep learning can learn effective policies when trained on large amounts of visual observations through reinforcement learning.

UNSUPERVISED DOMAIN ADAPTATION VISUAL NAVIGATION

0
26 Oct 2020

Learning to Set Waypoints for Audio-Visual Navigation

ICLR 2021 facebookresearch/sound-spaces

In audio-visual navigation, an agent intelligently travels through a complex, unmapped 3D environment using both sights and sounds to find a sound source (e. g., a phone ringing in another room).

VISUAL NAVIGATION

98
21 Aug 2020

Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without Sacrifices

6 Aug 2020maximecb/gym-miniworld

Learning a new task often requires both exploring to gather task-relevant information and exploiting this information to solve the task.

META REINFORCEMENT LEARNING VISUAL NAVIGATION

369
06 Aug 2020