Neural Latents Benchmark '21: Evaluating latent variable models of neural population activity

1 code implementation • 9 Sep 2021 • Felix Pei, Joel Ye, David Zoltowski, Anqi Wu, Raeed H. Chowdhury, Hansem Sohn, Joseph E. O'Doherty, Krishna V. Shenoy, Matthew T. Kaufman, Mark Churchland, Mehrdad Jazayeri, Lee E. Miller, Jonathan Pillow, Il Memming Park, Eva L. Dyer, Chethan Pandarinath

We curate four datasets of neural spiking activity from cognitive, sensory, and motor areas to promote models that apply to the wide variety of activity seen across these areas.

Representation learning for neural population activity with Neural Data Transformers

1 code implementation • 2 Aug 2021 • Joel Ye, Chethan Pandarinath

The NDT models these datasets as well as state-of-the-art recurrent models.

Representation Learning

Auxiliary Tasks and Exploration Enable ObjectNav

1 code implementation • 8 Apr 2021 • Joel Ye, Dhruv Batra, Abhishek Das, Erik Wijmans

We instead re-enable a generic learned agent by adding auxiliary learning tasks and an exploration reward.

Auxiliary Learning Navigate +1

Auxiliary Tasks and Exploration Enable ObjectGoal Navigation

no code implementations • ICCV 2021 • Joel Ye, Dhruv Batra, Abhishek Das, Erik Wijmans

We instead re-enable a generic learned agent by adding auxiliary learning tasks and an exploration reward.

Auxiliary Learning Navigate

Auxiliary Tasks Speed Up Learning PointGoal Navigation

1 code implementation • 9 Jul 2020 • Joel Ye, Dhruv Batra, Erik Wijmans, Abhishek Das

PointGoal Navigation is an embodied task that requires agents to navigate to a specified point in an unseen environment.

Navigate PointGoal Navigation