1 code implementation • 7 Oct 2024 • Bobak T. Kiani, Lukas Fesser, Melanie Weber
Data with geometric structure is ubiquitous in machine learning often arising from fundamental symmetries in a domain, such as permutation-invariance in graphs and translation-invariance in images.
no code implementations • 3 Jun 2024 • Bobak T. Kiani, Jason Wang, Melanie Weber
In this paper, we investigate the hardness of learning under the manifold hypothesis.
no code implementations • 3 Jan 2024 • Bobak T. Kiani, Thien Le, Hannah Lawrence, Stefanie Jegelka, Melanie Weber
We study the problem of learning equivariant neural networks via gradient descent.
1 code implementation • NeurIPS 2023 • Grégoire Mialon, Quentin Garrido, Hannah Lawrence, Danyal Rehman, Yann Lecun, Bobak T. Kiani
Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering.
no code implementations • 22 Feb 2023 • Omri Puny, Derek Lim, Bobak T. Kiani, Haggai Maron, Yaron Lipman
This paper introduces an alternative expressive power hierarchy based on the ability of GNNs to calculate equivariant polynomials of a certain degree.
no code implementations • 6 Feb 2023 • Vivien Cabannes, Bobak T. Kiani, Randall Balestriero, Yann Lecun, Alberto Bietti
Self-supervised learning (SSL) has emerged as a powerful framework to learn representations from raw data without supervision.
no code implementations • 29 Sep 2022 • Bobak T. Kiani, Randall Balestriero, Yubei Chen, Seth Lloyd, Yann Lecun
The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data.
1 code implementation • 12 Oct 2021 • Hannah Lawrence, Kristian Georgiev, Andrew Dienes, Bobak T. Kiani
Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and permutations, in their architectures.
no code implementations • 23 Sep 2021 • Grecia Castelazo, Quynh T. Nguyen, Giacomo De Palma, Dirk Englund, Seth Lloyd, Bobak T. Kiani
Group convolutions and cross-correlations, which are equivariant to the actions of group elements, are commonly used in mathematics to analyze or take advantage of symmetries inherent in a given problem setting.
1 code implementation • 13 Apr 2020 • Giacomo De Palma, Bobak T. Kiani, Seth Lloyd
We explore the properties of adversarial examples for deep neural networks with random weights and biases, and prove that for any $p\ge1$, the $\ell^p$ distance of any given input from the classification boundary scales as one over the square root of the dimension of the input times the $\ell^p$ norm of the input.