1 code implementation • NeurIPS 2021 • Zhanghao Wu, Paras Jain, Matthew A. Wright, Azalia Mirhoseini, Joseph E. Gonzalez, Ion Stoica
Inspired by recent computer vision results that find position-invariant attention performant in learning long-range relationships, our method, which we call GraphTrans, applies a permutation-invariant Transformer module after a standard GNN module.
no code implementations • 2 Jun 2021 • Matthew A. Wright, Joseph E. Gonzalez
In particular, we show that the "dot-product attention" that is the core of the Transformer's operation can be characterized as a kernel learning method on a pair of Banach spaces.
1 code implementation • 21 Apr 2021 • Nicholas Rhinehart, Jeff He, Charles Packer, Matthew A. Wright, Rowan Mcallister, Joseph E. Gonzalez, Sergey Levine
Humans have a remarkable ability to make decisions by accurately reasoning about future events, including the future behaviors and states of mind of other agents.
no code implementations • 31 May 2019 • Matthew A. Wright, Roberto Horowitz
Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time.
Multi-agent Reinforcement Learning
reinforcement-learning
+1
no code implementations • 18 Apr 2019 • Matthew A. Wright, Simon F. G. Ehlers, Roberto Horowitz
Deep neural networks can be powerful tools, but require careful application-specific design to ensure that the most informative relationships in the data are learnable.
no code implementations • 9 Apr 2018 • Randal Burns, Eric Perlman, Alex Baden, William Gray Roncal, Ben Falk, Vikram Chandrashekhar, Forrest Collman, Sharmishtaa Seshamani, Jesse Patsolic, Kunal Lillaney, Michael Kazhdan, Robert Hider Jr., Derek Pryor, Jordan Matelsky, Timothy Gion, Priya Manavalan, Brock Wester, Mark Chevillet, Eric T. Trautman, Khaled Khairy, Eric Bridgeford, Dean M. Kleissas, Daniel J. Tward, Ailey K. Crow, Matthew A. Wright, Michael I. Miller, Stephen J. Smith, R. Jacob Vogelstein, Karl Deisseroth, Joshua T. Vogelstein
Big imaging data is becoming more prominent in brain sciences across spatiotemporal scales and phylogenies.
Neurons and Cognition Quantitative Methods