no code implementations • 21 Apr 2024 • Sneh Pandya, Yuanyuan Yang, Nicholas Van Alfen, Jonathan Blazek, Robin Walters
The intrinsic alignments (IA) of galaxies, regarded as a contaminant in weak lensing analyses, represents the correlation of galaxy shapes due to gravitational tidal interactions and galaxy formation processes.
1 code implementation • 4 Feb 2024 • Mustafa Hajij, Mathilde Papillon, Florian Frantzen, Jens Agerberg, Ibrahem AlJabea, Ruben Ballester, Claudio Battiloro, Guillermo Bernárdez, Tolga Birdal, Aiden Brent, Peter Chin, Sergio Escalera, Simone Fiorellino, Odin Hoff Gardaa, Gurusankar Gopalakrishnan, Devendra Govil, Josef Hoppe, Maneel Reddy Karri, Jude Khouja, Manuel Lecha, Neal Livesay, Jan Meißner, Soham Mukherjee, Alexander Nikitin, Theodore Papamarkou, Jaro Prílepok, Karthikeyan Natesan Ramamurthy, Paul Rosen, Aldo Guzmán-Sáenz, Alessandro Salatiello, Shreyas N. Samaga, Simone Scardapane, Michael T. Schaub, Luca Scofano, Indro Spinelli, Lev Telyatnikov, Quang Truong, Robin Walters, Maosheng Yang, Olga Zaghen, Ghada Zamzmi, Ali Zia, Nina Miolane
We introduce TopoX, a Python software suite that provides reliable and user-friendly building blocks for computing and machine learning on topological domains that extend graphs: hypergraphs, simplicial, cellular, path and combinatorial complexes.
no code implementations • 22 Jan 2024 • Haojie Huang, Owen Howell, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt
Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions.
no code implementations • NeurIPS 2023 • Babak Esmaeili, Robin Walters, Heiko Zimmermann, Jan-Willem van de Meent
Incorporating geometric inductive biases into models can aid interpretability and generalization, but encoding to a specific geometric structure can be challenging due to the imposed topological constraints.
1 code implementation • 30 Oct 2023 • Niklas Smedemark-Margulies, Yunus Bicer, Elifnur Sunger, Tales Imbiriba, Eugene Tunik, Deniz Erdogmus, Mathew Yarossi, Robin Walters
New subjects only demonstrate the single component gestures and we seek to extrapolate from these to all possible single or combination gestures.
no code implementations • 3 Oct 2023 • Rui Wang, Elyssa Hofgard, Han Gao, Robin Walters, Tess E. Smidt
Modeling symmetry breaking is essential for understanding the fundamental changes in the behaviors and properties of physical systems, from microscopic particle interactions to macroscopic phenomena like fluid dynamics and cosmic structures.
no code implementations • 29 Sep 2023 • Jianke Yang, Nima Dehmamy, Robin Walters, Rose Yu
It learns a mapping from the data space to a latent space where the symmetries become linear and simultaneously discovers symmetries in the latent space.
1 code implementation • 26 Sep 2023 • Mathilde Papillon, Mustafa Hajij, Helen Jenne, Johan Mathe, Audun Myers, Theodore Papamarkou, Tolga Birdal, Tamal Dey, Tim Doster, Tegan Emerson, Gurusankar Gopalakrishnan, Devendra Govil, Aldo Guzmán-Sáenz, Henry Kvinge, Neal Livesay, Soham Mukherjee, Shreyas N. Samaga, Karthikeyan Natesan Ramamurthy, Maneel Reddy Karri, Paul Rosen, Sophia Sanborn, Robin Walters, Jens Agerberg, Sadrodin Barikbin, Claudio Battiloro, Gleb Bazhenov, Guillermo Bernardez, Aiden Brent, Sergio Escalera, Simone Fiorellino, Dmitrii Gavrilev, Mohammed Hassanin, Paul Häusner, Odin Hoff Gardaa, Abdelwahed Khamis, Manuel Lecha, German Magai, Tatiana Malygina, Rubén Ballester, Kalyan Nadimpalli, Alexander Nikitin, Abraham Rabinowitz, Alessandro Salatiello, Simone Scardapane, Luca Scofano, Suraj Singh, Jens Sjölund, Pavel Snopov, Indro Spinelli, Lev Telyatnikov, Lucia Testa, Maosheng Yang, Yixiao Yue, Olga Zaghen, Ali Zia, Nina Miolane
This paper presents the computational challenge on topological deep learning that was hosted within the ICML 2023 Workshop on Topology and Geometry in Machine Learning.
no code implementations • 15 Aug 2023 • Haojie Huang, Dian Wang, Arsh Tangri, Robin Walters, Robert Platt
This paper analytically studies the symmetries present in planar robotic pick and place and proposes a method of incorporating equivariant neural models into Transporter Net in a way that captures all symmetries.
1 code implementation • 17 Jul 2023 • Ayan Chatterjee, Robin Walters, Giulia Menichetti, Tina Eliassi-Rad
Our proposed method, UPNA (Unsupervised Pre-training of Node Attributes), solves the inductive link prediction problem by learning a function that takes a pair of node attributes and predicts the probability of an edge, as opposed to Graph Neural Networks (GNN), which can be prone to topological shortcuts in graphs with power-law degree distribution.
no code implementations • 17 Jul 2023 • Linfeng Zhao, Owen Howell, Jung Yeon Park, Xupeng Zhu, Robin Walters, Lawson L. S. Wong
In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws. These changes, which preserve distance, encompass isometric transformations such as translations, rotations, and reflections, collectively known as the Euclidean group.
no code implementations • 7 Jul 2023 • Owen Howell, David Klee, Ondrej Biza, Linfeng Zhao, Robin Walters
We show that an algorithm that learns a three-dimensional representation of the world from two dimensional images must satisfy certain geometric consistency properties which we formulate as SO(2)-equivariance constraints.
no code implementations • 21 Jun 2023 • Ondrej Biza, Skye Thompson, Kishore Reddy Pagidi, Abhinav Kumar, Elise van der Pol, Robin Walters, Thomas Kipf, Jan-Willem van de Meent, Lawson L. S. Wong, Robert Platt
We propose a new method, Interaction Warping, for learning SE(3) robotic manipulation policies from a single demonstration.
1 code implementation • 10 Jun 2023 • Xupeng Zhu, Dian Wang, Guanang Su, Ondrej Biza, Robin Walters, Robert Platt
Real-world grasp detection is challenging due to the stochasticity in grasp dynamics and the noise in hardware.
1 code implementation • 22 May 2023 • Bo Zhao, Robert M. Gower, Robin Walters, Rose Yu
Finally, we show that integrating teleportation into a wide range of optimization algorithms and optimization-based meta-learning improves convergence.
1 code implementation • 27 Feb 2023 • David M. Klee, Ondrej Biza, Robert Platt, Robin Walters
Predicting the pose of objects from a single image is an important but difficult computer vision problem.
1 code implementation • 1 Feb 2023 • Jianke Yang, Robin Walters, Nima Dehmamy, Rose Yu
Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori.
no code implementations • 16 Nov 2022 • Dian Wang, Jung Yeon Park, Neel Sortur, Lawson L. S. Wong, Robin Walters, Robert Platt
Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture.
no code implementations • 31 Oct 2022 • Haojie Huang, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt
Given point cloud input, the problem of 6-DoF grasp pose detection is to identify a set of hand poses in SE(3) from which an object can be successfully grasped.
1 code implementation • 31 Oct 2022 • Bo Zhao, Iordan Ganev, Robin Walters, Rose Yu, Nima Dehmamy
Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys.
1 code implementation • 24 Aug 2022 • Sidharth Malhotra, Robin Walters
Secondly, we test the impact of varying the length of protein sequence we input into the model.
no code implementations • 26 Jul 2022 • Iordan Ganev, Robin Walters
We develop a uniform theoretical approach towards the analysis of various neural network connectivity architectures by introducing the notion of a quiver neural network.
no code implementations • 18 Jul 2022 • David Klee, Ondrej Biza, Robert Platt, Robin Walters
In this paper, we propose a novel architecture based on icosahedral group convolutions that reasons in $\mathrm{SO(3)}$ by learning a projection of the input image onto an icosahedron.
no code implementations • 19 Jun 2022 • Rui Wang, Robin Walters, Rose Yu
In this work, we derive the generalization bounds for data augmentation and equivariant networks, characterizing their effect on learning in a unified framework.
no code implementations • 8 Jun 2022 • Linfeng Zhao, Xupeng Zhu, Lingzhi Kong, Robin Walters, Lawson L. S. Wong
Our implementation is based on VINs and uses steerable convolution networks to incorporate symmetry.
3 code implementations • 1 Jun 2022 • Mustafa Hajij, Ghada Zamzmi, Theodore Papamarkou, Nina Miolane, Aldo Guzmán-Sáenz, Karthikeyan Natesan Ramamurthy, Tolga Birdal, Tamal K. Dey, Soham Mukherjee, Shreyas N. Samaga, Neal Livesay, Robin Walters, Paul Rosen, Michael T. Schaub
Topological deep learning is a rapidly growing field that pertains to the development of deep learning models for data supported on topological domains such as simplicial complexes, cell complexes, and hypergraphs, which generalize many domains encountered in scientific computations.
1 code implementation • 21 May 2022 • Bo Zhao, Nima Dehmamy, Robin Walters, Rose Yu
Experimentally, we show that teleportation improves the convergence speed of gradient descent and AdaGrad for several optimization problems including test functions, multi-layer regressions, and MNIST classification.
1 code implementation • 4 May 2022 • Sophia Sun, Robin Walters, Jinxi Li, Rose Yu
We propose a novel deep dynamics model, Probabilistic Equivariant Continuous COnvolution (PECCO) for probabilistic prediction of multi-agent trajectories.
no code implementations • 28 Apr 2022 • Linfeng Zhao, Lingzhi Kong, Robin Walters, Lawson L. S. Wong
Compositional generalization is a critical ability in learning and decision-making.
1 code implementation • 24 Apr 2022 • Jung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan Willem van de Meent, Robin Walters
Incorporating symmetries can lead to highly data-efficient and generalizable models by defining equivalence classes of data samples related by transformations.
1 code implementation • 28 Jan 2022 • Rui Wang, Robin Walters, Rose Yu
Incorporating symmetry as an inductive bias into neural network architecture has led to improvements in generalization, data efficiency, and physical consistency in dynamics modeling.
2 code implementations • 25 Dec 2021 • Ayan Chatterjee, Robin Walters, Zohair Shafi, Omair Shafi Ahmed, Michael Sebek, Deisy Gysi, Rose Yu, Tina Eliassi-Rad, Albert-László Barabási, Giulia Menichetti
Identifying novel drug-target interactions (DTI) is a critical and rate limiting step in drug discovery.
no code implementations • 29 Sep 2021 • Iordan Ganev, Robin Walters
We provide a theoretical framework for neural networks in terms of the representation theory of quivers, thus revealing symmetries of the parameter space of neural networks.
no code implementations • 29 Sep 2021 • Jung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan-Willem van de Meent, Robin Walters
In this paper, we use equivariant transition models as an inductive bias to learn symmetric latent representations in a self-supervised manner.
1 code implementation • NeurIPS 2021 • Nima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang, Rose Yu
Existing equivariant neural networks require prior knowledge of the symmetry group and discretization for continuous groups.
1 code implementation • 6 Jul 2021 • Iordan Ganev, Twan van Laarhoven, Robin Walters
We introduce a class of fully-connected neural networks whose activation functions, rather than being pointwise, rescale feature vectors by a function depending only on their norm.
1 code implementation • 12 Apr 2021 • Steven Wong, Lejun Jiang, Robin Walters, Tamás G. Molnár, Gábor Orosz, Rose Yu
In order to best utilize real-world V2V communication data, we integrate first principle models with deep learning.
1 code implementation • 20 Feb 2021 • Rui Wang, Robin Walters, Rose Yu
DyAd has two parts: an encoder which infers the time-invariant hidden features of the task with weak supervision, and a forecaster which learns the shared dynamics of the entire domain.
no code implementations • 1 Jan 2021 • Nima Dehmamy, Yanchen Liu, Robin Walters, Rose Yu
We propose to learn the symmetries during the training of the group equivariant architectures.
no code implementations • ICLR 2021 • Robin Walters, Jinxi Li, Rose Yu
Trajectory prediction is a critical part of many AI applications, for example, the safe operation of autonomous vehicles.
1 code implementation • ICLR 2021 • Rui Wang, Robin Walters, Rose Yu
Recent work has shown deep learning can accelerate the prediction of physical dynamics relative to numerical solvers.