Search Results for author: Robin Walters

Found 41 papers, 21 papers with code

Learning Galaxy Intrinsic Alignment Correlations

no code implementations21 Apr 2024 Sneh Pandya, Yuanyuan Yang, Nicholas Van Alfen, Jonathan Blazek, Robin Walters

The intrinsic alignments (IA) of galaxies, regarded as a contaminant in weak lensing analyses, represents the correlation of galaxy shapes due to gravitational tidal interactions and galaxy formation processes.

Position

Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D

no code implementations22 Jan 2024 Haojie Huang, Owen Howell, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt

Many complex robotic manipulation tasks can be decomposed as a sequence of pick and place actions.

Topological Obstructions and How to Avoid Them

no code implementations NeurIPS 2023 Babak Esmaeili, Robin Walters, Heiko Zimmermann, Jan-Willem van de Meent

Incorporating geometric inductive biases into models can aid interpretability and generalization, but encoding to a specific geometric structure can be challenging due to the imposed topological constraints.

Discovering Symmetry Breaking in Physical Systems with Relaxed Group Convolution

no code implementations3 Oct 2023 Rui Wang, Elyssa Hofgard, Han Gao, Robin Walters, Tess E. Smidt

Modeling symmetry breaking is essential for understanding the fundamental changes in the behaviors and properties of physical systems, from microscopic particle interactions to macroscopic phenomena like fluid dynamics and cosmic structures.

Super-Resolution

Latent Space Symmetry Discovery

no code implementations29 Sep 2023 Jianke Yang, Nima Dehmamy, Robin Walters, Rose Yu

It learns a mapping from the data space to a latent space where the symmetries become linear and simultaneously discovers symmetries in the latent space.

Leveraging Symmetries in Pick and Place

no code implementations15 Aug 2023 Haojie Huang, Dian Wang, Arsh Tangri, Robin Walters, Robert Platt

This paper analytically studies the symmetries present in planar robotic pick and place and proposes a method of incorporating equivariant neural models into Transporter Net in a way that captures all symmetries.

Imitation Learning

Disentangling Node Attributes from Graph Topology for Improved Generalizability in Link Prediction

1 code implementation17 Jul 2023 Ayan Chatterjee, Robin Walters, Giulia Menichetti, Tina Eliassi-Rad

Our proposed method, UPNA (Unsupervised Pre-training of Node Attributes), solves the inductive link prediction problem by learning a function that takes a pair of node attributes and predicts the probability of an edge, as opposed to Graph Neural Networks (GNN), which can be prone to topological shortcuts in graphs with power-law degree distribution.

Graph Generation Inductive Link Prediction +1

Can Euclidean Symmetry be Leveraged in Reinforcement Learning and Planning?

no code implementations17 Jul 2023 Linfeng Zhao, Owen Howell, Jung Yeon Park, Xupeng Zhu, Robin Walters, Lawson L. S. Wong

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws. These changes, which preserve distance, encompass isometric transformations such as translations, rotations, and reflections, collectively known as the Euclidean group.

reinforcement-learning

Equivariant Single View Pose Prediction Via Induced and Restricted Representations

no code implementations7 Jul 2023 Owen Howell, David Klee, Ondrej Biza, Linfeng Zhao, Robin Walters

We show that an algorithm that learns a three-dimensional representation of the world from two dimensional images must satisfy certain geometric consistency properties which we formulate as SO(2)-equivariance constraints.

Pose Estimation Pose Prediction

On Robot Grasp Learning Using Equivariant Models

1 code implementation10 Jun 2023 Xupeng Zhu, Dian Wang, Guanang Su, Ondrej Biza, Robin Walters, Robert Platt

Real-world grasp detection is challenging due to the stochasticity in grasp dynamics and the noise in hardware.

Inductive Bias

Improving Convergence and Generalization Using Parameter Symmetries

1 code implementation22 May 2023 Bo Zhao, Robert M. Gower, Robin Walters, Rose Yu

Finally, we show that integrating teleportation into a wide range of optimization algorithms and optimization-based meta-learning improves convergence.

Meta-Learning

Image to Sphere: Learning Equivariant Features for Efficient Pose Prediction

1 code implementation27 Feb 2023 David M. Klee, Ondrej Biza, Robert Platt, Robin Walters

Predicting the pose of objects from a single image is an important but difficult computer vision problem.

Pose Prediction

Generative Adversarial Symmetry Discovery

1 code implementation1 Feb 2023 Jianke Yang, Robin Walters, Nima Dehmamy, Rose Yu

Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori.

Inductive Bias Trajectory Prediction

The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry

no code implementations16 Nov 2022 Dian Wang, Jung Yeon Park, Neel Sortur, Lawson L. S. Wong, Robin Walters, Robert Platt

Extensive work has demonstrated that equivariant neural networks can significantly improve sample efficiency and generalization by enforcing an inductive bias in the network architecture.

Inductive Bias

Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection

no code implementations31 Oct 2022 Haojie Huang, Dian Wang, Xupeng Zhu, Robin Walters, Robert Platt

Given point cloud input, the problem of 6-DoF grasp pose detection is to identify a set of hand poses in SE(3) from which an object can be successfully grasped.

Symmetries, flat minima, and the conserved quantities of gradient flow

1 code implementation31 Oct 2022 Bo Zhao, Iordan Ganev, Robin Walters, Rose Yu, Nima Dehmamy

Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys.

Secondary Protein Structure Prediction Using Neural Networks

1 code implementation24 Aug 2022 Sidharth Malhotra, Robin Walters

Secondly, we test the impact of varying the length of protein sequence we input into the model.

Protein Structure Prediction

Quiver neural networks

no code implementations26 Jul 2022 Iordan Ganev, Robin Walters

We develop a uniform theoretical approach towards the analysis of various neural network connectivity architectures by introducing the notion of a quiver neural network.

Model Compression

Image to Icosahedral Projection for $\mathrm{SO}(3)$ Object Reasoning from Single-View Images

no code implementations18 Jul 2022 David Klee, Ondrej Biza, Robert Platt, Robin Walters

In this paper, we propose a novel architecture based on icosahedral group convolutions that reasons in $\mathrm{SO(3)}$ by learning a projection of the input image onto an icosahedron.

Object Pose Estimation

Data Augmentation vs. Equivariant Networks: A Theory of Generalization on Dynamics Forecasting

no code implementations19 Jun 2022 Rui Wang, Robin Walters, Rose Yu

In this work, we derive the generalization bounds for data augmentation and equivariant networks, characterizing their effect on learning in a unified framework.

Data Augmentation Generalization Bounds

Topological Deep Learning: Going Beyond Graph Data

3 code implementations1 Jun 2022 Mustafa Hajij, Ghada Zamzmi, Theodore Papamarkou, Nina Miolane, Aldo Guzmán-Sáenz, Karthikeyan Natesan Ramamurthy, Tolga Birdal, Tamal K. Dey, Soham Mukherjee, Shreyas N. Samaga, Neal Livesay, Robin Walters, Paul Rosen, Michael T. Schaub

Topological deep learning is a rapidly growing field that pertains to the development of deep learning models for data supported on topological domains such as simplicial complexes, cell complexes, and hypergraphs, which generalize many domains encountered in scientific computations.

Graph Learning

Symmetry Teleportation for Accelerated Optimization

1 code implementation21 May 2022 Bo Zhao, Nima Dehmamy, Robin Walters, Rose Yu

Experimentally, we show that teleportation improves the convergence speed of gradient descent and AdaGrad for several optimization problems including test functions, multi-layer regressions, and MNIST classification.

Second-order methods

Probabilistic Symmetry for Multi-Agent Dynamics

1 code implementation4 May 2022 Sophia Sun, Robin Walters, Jinxi Li, Rose Yu

We propose a novel deep dynamics model, Probabilistic Equivariant Continuous COnvolution (PECCO) for probabilistic prediction of multi-agent trajectories.

Autonomous Driving Collision Avoidance +3

Learning Symmetric Embeddings for Equivariant World Models

1 code implementation24 Apr 2022 Jung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan Willem van de Meent, Robin Walters

Incorporating symmetries can lead to highly data-efficient and generalizable models by defining equivalence classes of data samples related by transformations.

Approximately Equivariant Networks for Imperfectly Symmetric Dynamics

1 code implementation28 Jan 2022 Rui Wang, Robin Walters, Rose Yu

Incorporating symmetry as an inductive bias into neural network architecture has led to improvements in generalization, data efficiency, and physical consistency in dynamics modeling.

Inductive Bias

Model Compression via Symmetries of the Parameter Space

no code implementations29 Sep 2021 Iordan Ganev, Robin Walters

We provide a theoretical framework for neural networks in terms of the representation theory of quivers, thus revealing symmetries of the parameter space of neural networks.

Model Compression

Learning Symmetric Representations for Equivariant World Models

no code implementations29 Sep 2021 Jung Yeon Park, Ondrej Biza, Linfeng Zhao, Jan-Willem van de Meent, Robin Walters

In this paper, we use equivariant transition models as an inductive bias to learn symmetric latent representations in a self-supervised manner.

Inductive Bias

Automatic Symmetry Discovery with Lie Algebra Convolutional Network

1 code implementation NeurIPS 2021 Nima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang, Rose Yu

Existing equivariant neural networks require prior knowledge of the symmetry group and discretization for continuous groups.

Universal approximation and model compression for radial neural networks

1 code implementation6 Jul 2021 Iordan Ganev, Twan van Laarhoven, Robin Walters

We introduce a class of fully-connected neural networks whose activation functions, rather than being pointwise, rescale feature vectors by a function depending only on their norm.

Model Compression

Traffic Forecasting using Vehicle-to-Vehicle Communication

1 code implementation12 Apr 2021 Steven Wong, Lejun Jiang, Robin Walters, Tamás G. Molnár, Gábor Orosz, Rose Yu

In order to best utilize real-world V2V communication data, we integrate first principle models with deep learning.

Meta-Learning Dynamics Forecasting Using Task Inference

1 code implementation20 Feb 2021 Rui Wang, Robin Walters, Rose Yu

DyAd has two parts: an encoder which infers the time-invariant hidden features of the task with weak supervision, and a forecaster which learns the shared dynamics of the entire domain.

Meta-Learning

Lie Algebra Convolutional Neural Networks with Automatic Symmetry Extraction

no code implementations1 Jan 2021 Nima Dehmamy, Yanchen Liu, Robin Walters, Rose Yu

We propose to learn the symmetries during the training of the group equivariant architectures.

Trajectory Prediction using Equivariant Continuous Convolution

no code implementations ICLR 2021 Robin Walters, Jinxi Li, Rose Yu

Trajectory prediction is a critical part of many AI applications, for example, the safe operation of autonomous vehicles.

Autonomous Vehicles Trajectory Prediction

Incorporating Symmetry into Deep Dynamics Models for Improved Generalization

1 code implementation ICLR 2021 Rui Wang, Robin Walters, Rose Yu

Recent work has shown deep learning can accelerate the prediction of physical dynamics relative to numerical solvers.

Cannot find the paper you are looking for? You can Submit a new open access paper.