Search Results for author: Omri Azencot

Found 11 papers, 6 papers with code

Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEs

no code implementations4 Oct 2023 Ilan Naiman, N. Benjamin Erichson, Pu Ren, Michael W. Mahoney, Omri Azencot

In this work, we introduce Koopman VAE (KVAE), a new generative framework that is based on a novel design for the model prior, and that can be optimized for either regular and irregular training data.

Irregular Time Series Time Series +1

Data Representations' Study of Latent Image Manifolds

1 code implementation31 May 2023 Ilya Kaufman, Omri Azencot

In contrast, this behavior does not appear in untrained networks in which the curvature flattens.

Image Classification

Multifactor Sequential Disentanglement via Structured Koopman Autoencoders

1 code implementation30 Mar 2023 Nimrod Berman, Ilan Naiman, Omri Azencot

Disentangling complex data to its latent factors of variation is a fundamental task in representation learning.

Disentanglement Inductive Bias

Eigenvalue initialisation and regularisation for Koopman autoencoders

no code implementations23 Dec 2022 Jack W. Miller, Charles O'Neill, Navid C. Constantinou, Omri Azencot

In addition, we suggest the "eigenloss" penalty scheme that penalises the eigenvalues of the Koopman operator during training.

Inductive Bias

A Differential Geometry Perspective on Orthogonal Recurrent Models

no code implementations18 Feb 2021 Omri Azencot, N. Benjamin Erichson, Mirela Ben-Chen, Michael W. Mahoney

In this work, we employ tools and insights from differential geometry to offer a novel perspective on orthogonal RNNs.

An Operator Theoretic Approach for Analyzing Sequence Neural Networks

1 code implementation15 Feb 2021 Ilan Naiman, Omri Azencot

In contrast, we propose to analyze trained neural networks using an operator theoretic approach which is rooted in Koopman theory, the Koopman Analysis of Neural Networks (KANN).

ECG Classification Sentiment Analysis +1

Modes of Homogeneous Gradient Flows

no code implementations3 Jul 2020 Ido Cohen, Omri Azencot, Pavel Lifshitz, Guy Gilboa

Definitions for spectrum and filtering are given, and a Parseval-type identity is shown.

Dynamical Systems Computational Engineering, Finance, and Science

Lipschitz Recurrent Neural Networks

1 code implementation ICLR 2021 N. Benjamin Erichson, Omri Azencot, Alejandro Queiruga, Liam Hodgkinson, Michael W. Mahoney

Viewing recurrent neural networks (RNNs) as continuous-time dynamical systems, we propose a recurrent unit that describes the hidden state's evolution with two parts: a well-understood linear component plus a Lipschitz nonlinearity.

Language Modelling Sequential Image Classification

Forecasting Sequential Data using Consistent Koopman Autoencoders

1 code implementation ICML 2020 Omri Azencot, N. Benjamin Erichson, Vanessa Lin, Michael W. Mahoney

Recurrent neural networks are widely used on time series data, yet such models often ignore the underlying physical structures in such sequences.

Time Series Time Series Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.