Search Results for author: Guy Wolf

Found 71 papers, 25 papers with code

Channel-Selective Normalization for Label-Shift Robust Test-Time Adaptation

no code implementations7 Feb 2024 Pedro Vianna, Muawiz Chaudhary, Paria Mehrbod, An Tang, Guy Cloutier, Guy Wolf, Michael Eickenberg, Eugene Belilovsky

However, in many practical applications this technique is vulnerable to label distribution shifts, sometimes producing catastrophic failure.

Test-time Adaptation

Effective Protein-Protein Interaction Exploration with PPIretrieval

no code implementations6 Feb 2024 Chenqing Hua, Connor Coley, Guy Wolf, Doina Precup, Shuangjia Zheng

Protein-protein interactions (PPIs) are crucial in regulating numerous cellular functions, including signal transduction, transportation, and immune defense.

Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy

no code implementations4 Dec 2023 Danqi Liao, Chen Liu, Benjamin W. Christensen, Alexander Tong, Guillaume Huguet, Guy Wolf, Maximilian Nickel, Ian Adelstein, Smita Krishnaswamy

Entropy and mutual information in neural networks provide rich information on the learning process, but they have proven difficult to compute reliably in high dimensions.

Spectral Temporal Contrastive Learning

no code implementations1 Dec 2023 Sacha Morin, Somjit Nath, Samira Ebrahimi Kahou, Guy Wolf

This work is concerned with the temporal contrastive learning (TCL) setting where the sequential structure of the data is used instead to define positive pairs, which is more commonly used in RL and robotics contexts.

Contrastive Learning Self-Supervised Learning

Graph topological property recovery with heat and wave dynamics-based features on graphs

no code implementations18 Sep 2023 Dhananjay Bhaskar, Yanlei Zhang, Charles Xu, Xingzhi Sun, Oluwadamilola Fasina, Guy Wolf, Maximilian Nickel, Michael Perlmutter, Smita Krishnaswamy

In this paper, we propose Graph Differential Equation Network (GDeNet), an approach that harnesses the expressive power of solutions to PDEs on a graph to obtain continuous node- and graph-level representations for various downstream tasks.

Graph Positional and Structural Encoder

1 code implementation14 Jul 2023 Renming Liu, Semih Cantürk, Olivier Lapointe-Gagné, Vincent Létourneau, Guy Wolf, Dominique Beaini, Ladislav Rampášek

Positional and structural encodings (PSE) enable better identifiability of nodes within a graph, as in general graphs lack a canonical node ordering.

Simulation-free Schrödinger bridges via score and flow matching

1 code implementation7 Jul 2023 Alexander Tong, Nikolay Malkin, Kilian Fatras, Lazar Atanackovic, Yanlei Zhang, Guillaume Huguet, Guy Wolf, Yoshua Bengio

We present simulation-free score and flow matching ([SF]$^2$M), a simulation-free objective for inferring stochastic dynamics given unpaired samples drawn from arbitrary source and target distributions.

Graph Fourier MMD for Signals on Graphs

no code implementations5 Jun 2023 Samuel Leone, Aarthi Venkat, Guillaume Huguet, Alexander Tong, Guy Wolf, Smita Krishnaswamy

GFMMD is defined via an optimal witness function that is both smooth on the graph and maximizes difference in expectation between the pair of distributions on the graph.

Neural FIM for learning Fisher Information Metrics from point cloud data

1 code implementation1 Jun 2023 Oluwadamilola Fasina, Guillaume Huguet, Alexander Tong, Yanlei Zhang, Guy Wolf, Maximilian Nickel, Ian Adelstein, Smita Krishnaswamy

Although data diffusion embeddings are ubiquitous in unsupervised learning and have proven to be a viable technique for uncovering the underlying intrinsic geometry of data, diffusion embeddings are inherently limited due to their discrete nature.

A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reduction

1 code implementation NeurIPS 2023 Guillaume Huguet, Alexander Tong, Edward De Brouwer, Yanlei Zhang, Guy Wolf, Ian Adelstein, Smita Krishnaswamy

Finally, we show that parameters of our more general method can be configured to give results similar to PHATE (a state-of-the-art diffusion based manifold learning method) as well as SNE (an attraction/repulsion neighborhood based method that forms the basis of t-SNE).

Denoising Dimensionality Reduction +1

Improving and generalizing flow-based generative models with minibatch optimal transport

2 code implementations1 Feb 2023 Alexander Tong, Kilian Fatras, Nikolay Malkin, Guillaume Huguet, Yanlei Zhang, Jarrid Rector-Brooks, Guy Wolf, Yoshua Bengio

CFM features a stable regression objective like that used to train the stochastic flow in diffusion models but enjoys the efficient inference of deterministic flow models.

Reliability of CKA as a Similarity Measure in Deep Learning

no code implementations28 Oct 2022 MohammadReza Davari, Stefan Horoi, Amine Natik, Guillaume Lajoie, Guy Wolf, Eugene Belilovsky

Comparing learned neural representations in neural networks is a challenging but important problem, which has been approached in different ways.

Attribute

Manifold Alignment with Label Information

no code implementations23 Oct 2022 Andres F. Duque, Myriam Lizotte, Guy Wolf, Kevin R. Moon

With this in mind, we present a novel manifold alignment method called MALI (Manifold alignment with label information) that learns a correspondence between two distinct domains.

Domain Adaptation Transfer Learning

Learnable Filters for Geometric Scattering Modules

no code implementations15 Aug 2022 Alexander Tong, Frederik Wenkel, Dhananjay Bhaskar, Kincaid MacDonald, Jackson Grady, Michael Perlmutter, Smita Krishnaswamy, Guy Wolf

We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters.

Descriptive Graph Classification

Manifold Interpolating Optimal-Transport Flows for Trajectory Inference

no code implementations29 Jun 2022 Guillaume Huguet, D. S. Magruder, Alexander Tong, Oluwadamilola Fasina, Manik Kuchroo, Guy Wolf, Smita Krishnaswamy

In GAE the latent space distance between points is regularized to match a novel multiscale geodesic distance on the data manifold that we define.

Long Range Graph Benchmark

2 code implementations16 Jun 2022 Vijay Prakash Dwivedi, Ladislav Rampášek, Mikhail Galkin, Ali Parviz, Guy Wolf, Anh Tuan Luu, Dominique Beaini

Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer.

Benchmarking Graph Classification +4

Diffusion Transport Alignment

no code implementations15 Jun 2022 Andres F. Duque, Guy Wolf, Kevin R. Moon

The integration of multimodal data presents a challenge in cases when the study of a given phenomena by different instruments or conditions generates distinct but related domains.

Data Integration Domain Adaptation

Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?

1 code implementation3 Jun 2022 Yimeng Min, Frederik Wenkel, Michael Perlmutter, Guy Wolf

We propose a geometric scattering-based graph neural network (GNN) for approximating solutions of the NP-hard maximum clique (MC) problem.

Recipe for a General, Powerful, Scalable Graph Transformer

3 code implementations25 May 2022 Ladislav Rampášek, Mikhail Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu, Guy Wolf, Dominique Beaini

We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer with linear complexity and state-of-the-art results on a diverse set of benchmarks.

Graph Classification Graph Property Prediction +4

Time-inhomogeneous diffusion geometry and topology

no code implementations28 Mar 2022 Guillaume Huguet, Alexander Tong, Bastian Rieck, Jessie Huang, Manik Kuchroo, Matthew Hirn, Guy Wolf, Smita Krishnaswamy

From a geometric perspective, we obtain convergence bounds based on the smallest transition probability and the radius of the data, whereas from a spectral perspective, our bounds are based on the eigenspectrum of the diffusion kernel.

Clustering Denoising +1

Overcoming Oversmoothness in Graph Convolutional Networks via Hybrid Scattering Networks

no code implementations22 Jan 2022 Frederik Wenkel, Yimeng Min, Matthew Hirn, Michael Perlmutter, Guy Wolf

We further introduce an attention framework that allows the model to locally attend over combined information from different filters at the node level.

Learning shared neural manifolds from multi-subject FMRI data

no code implementations22 Dec 2021 Jessie Huang, Erica L. Busch, Tom Wallenstein, Michal Gerasimiuk, Andrew Benz, Guillaume Lajoie, Guy Wolf, Nicholas B. Turk-Browne, Smita Krishnaswamy

In order to understand the connection between stimuli of interest and brain activity, and analyze differences and commonalities between subjects, it becomes important to learn a meaningful embedding of the data that denoises, and reveals its intrinsic structure.

Brain Computer Interface

MURAL: An Unsupervised Random Forest-Based Embedding for Electronic Health Record Data

1 code implementation19 Nov 2021 Michal Gerasimiuk, Dennis Shung, Alexander Tong, Adrian Stanley, Michael Schultz, Jeffrey Ngu, Loren Laine, Guy Wolf, Smita Krishnaswamy

In particular, in EHR data, some variables are {\em missing not at random (MNAR)} but deliberately not collected and thus are a source of information.

Dimensionality Reduction

Exploring the Optimality of Tight-Frame Scattering Networks

no code implementations29 Sep 2021 Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Sajjad Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf

The wavelet filters used in the scattering transform are typically selected to create a tight frame via a parameterized mother wavelet.

Embedding Signals on Knowledge Graphs with Unbalanced Diffusion Earth Mover's Distance

no code implementations26 Jul 2021 Alexander Tong, Guillaume Huguet, Dennis Shung, Amine Natik, Manik Kuchroo, Guillaume Lajoie, Guy Wolf, Smita Krishnaswamy

We propose to compare and organize such datasets of graph signals by using an earth mover's distance (EMD) with a geodesic cost over the underlying graph.

Knowledge Graph Embedding Knowledge Graphs

Hierarchical graph neural nets can capture long-range interactions

1 code implementation15 Jul 2021 Ladislav Rampášek, Guy Wolf

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs.

Benchmarking Molecular Property Prediction +1

Diffusion Earth Mover's Distance and Distribution Embeddings

1 code implementation25 Feb 2021 Alexander Tong, Guillaume Huguet, Amine Natik, Kincaid MacDonald, Manik Kuchroo, Ronald Coifman, Guy Wolf, Smita Krishnaswamy

Here, Diffusion EMD can derive distances between patients on the manifold of cells at least two orders of magnitude faster than equally accurate methods.

Multimodal Data Visualization and Denoising with Integrated Diffusion

no code implementations12 Feb 2021 Manik Kuchroo, Abhinav Godavarthi, Alexander Tong, Guy Wolf, Smita Krishnaswamy

We propose a method called integrated diffusion for combining multimodal datasets, or data gathered via several different measurements on the same system, to create a joint data diffusion operator.

Clustering Data Visualization +1

Exploring the Geometry and Topology of Neural Network Loss Landscapes

no code implementations31 Jan 2021 Stefan Horoi, Jessie Huang, Bastian Rieck, Guillaume Lajoie, Guy Wolf, Smita Krishnaswamy

This suggests that qualitative and quantitative examination of the loss landscape geometry could yield insights about neural network generalization performance during training.

Dimensionality Reduction

Decoupled Greedy Learning of Graph Neural Networks

no code implementations1 Jan 2021 Yewen Wang, Jian Tang, Yizhou Sun, Guy Wolf

We empirically analyse our proposed DGL-GNN model, and demonstrate its effectiveness and superior efficiency through a range of experiments.

Geometric Scattering Attention Networks

1 code implementation28 Oct 2020 Yimeng Min, Frederik Wenkel, Guy Wolf

Geometric scattering has recently gained recognition in graph representation learning, and recent work has shown that integrating scattering features in graph convolution networks (GCNs) can alleviate the typical oversmoothing of features in node representation learning.

Graph Representation Learning Node Classification

Data-Driven Learning of Geometric Scattering Networks

no code implementations6 Oct 2020 Alexander Tong, Frederik Wenkel, Kincaid MacDonald, Smita Krishnaswamy, Guy Wolf

We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters.

Descriptive Graph Classification

Extendable and invertible manifold learning with geometry regularized autoencoders

no code implementations14 Jul 2020 Andrés F. Duque, Sacha Morin, Guy Wolf, Kevin R. Moon

Our regularization, based on the diffusion potential distances from the recently-proposed PHATE visualization method, encourages the learned latent representation to follow intrinsic data geometry, similar to manifold learning algorithms, while still enabling faithful extension to new data and reconstruction of data in the original feature space from latent coordinates.

Representation Learning

Advantages of biologically-inspired adaptive neural activation in RNNs during learning

no code implementations22 Jun 2020 Victor Geadah, Giancarlo Kerg, Stefan Horoi, Guy Wolf, Guillaume Lajoie

Dynamic adaptation in single-neuron response plays a fundamental role in neural coding in biological neural networks.

Transfer Learning

Supervised Visualization for Data Exploration

no code implementations15 Jun 2020 Jake S. Rhodes, Adele Cutler, Guy Wolf, Kevin R. Moon

We show, both qualitatively and quantitatively, the advantages of our approach in retaining local and global structures in data, while emphasizing important variables in the low-dimensional embedding.

Data Visualization Supervised dimensionality reduction

Uncovering the Topology of Time-Varying fMRI Data using Cubical Persistence

1 code implementation NeurIPS 2020 Bastian Rieck, Tristan Yates, Christian Bock, Karsten Borgwardt, Guy Wolf, Nicholas Turk-Browne, Smita Krishnaswamy

We observe significant differences in both brain state trajectories and overall topological activity between adults and children watching the same movie.

Clustering

Uncovering the Folding Landscape of RNA Secondary Structure with Deep Graph Embeddings

2 code implementations12 Jun 2020 Egbert Castro, Andrew Benz, Alexander Tong, Guy Wolf, Smita Krishnaswamy

We propose a geometric scattering autoencoder (GSAE) network for learning such graph embeddings.

Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks

1 code implementation NeurIPS 2020 Yimeng Min, Frederik Wenkel, Guy Wolf

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features.

Graph Attention Node Classification

Identifying Critical Neurons in ANN Architectures using Mixed Integer Programming

1 code implementation17 Feb 2020 Mostafa ElAraby, Guy Wolf, Margarida Carvalho

We introduce a mixed integer program (MIP) for assigning importance scores to each neuron in deep neural network architectures which is guided by the impact of their simultaneous pruning on the main learning task of the network.

TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular Dynamics

2 code implementations ICML 2020 Alexander Tong, Jessie Huang, Guy Wolf, David van Dijk, Smita Krishnaswamy

To address this issue, we establish a link between continuous normalizing flows and dynamic optimal transport, that allows us to model the expected paths of points over time.

Internal representation dynamics and geometry in recurrent neural networks

no code implementations9 Jan 2020 Stefan Horoi, Guillaume Lajoie, Guy Wolf

The efficiency of recurrent neural networks (RNNs) in dealing with sequential data has long been established.

Attribute

Understanding Graph Neural Networks with Generalized Geometric Scattering Transforms

1 code implementation14 Nov 2019 Michael Perlmutter, Alexander Tong, Feng Gao, Guy Wolf, Matthew Hirn

As a result, the proposed construction unifies and extends known theoretical results for many of the existing graph scattering architectures.

Beyond GANs: Transforming without a Target Distribution

no code implementations25 Sep 2019 Matthew Amodio, David van Dijk, Ruth Montgomery, Guy Wolf, Smita Krishnaswamy

While generative neural networks can learn to transform a specific input dataset into a specific target dataset, they require having just such a paired set of input/output datasets.

Generative Adversarial Network

Visualizing High Dimensional Dynamical Processes

no code implementations25 Jun 2019 Andrés F. Duque, Guy Wolf, Kevin R. Moon

Manifold learning techniques for dynamical systems and time series have shown their utility for a broad spectrum of applications in recent years.

EEG Electroencephalogram (EEG) +3

Fixing Bias in Reconstruction-based Anomaly Detection with Lipschitz Discriminators

no code implementations26 May 2019 Alexander Tong, Guy Wolf, Smita Krishnaswamy

We show that this procedure successfully detects unseen anomalies with guarantees on those that have a certain Wasserstein distance from the data or corrupted training set.

Anomaly Detection

Geometric Wavelet Scattering Networks on Compact Riemannian Manifolds

no code implementations24 May 2019 Michael Perlmutter, Feng Gao, Guy Wolf, Matthew Hirn

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of convolutional neural networks.

Translation

An Investigation of Memory in Recurrent Neural Networks

no code implementations17 May 2019 Aude Forcione-Lambert, Guy Wolf, Guillaume Lajoie

We investigate the learned dynamical landscape of a recurrent neural network solving a simple task requiring the interaction of two memory mechanisms: long- and short-term.

Graph Spectral Regularization For Neural Network Interpretability

no code implementations ICLR 2019 Alexander Tong, David van Dijk, Jay Stanley, Guy Wolf, Smita Krishnaswamy

First, we show a synthetic example that the graph-structured layer can reveal topological features of the data.

Graph Classification with Geometric Scattering

no code implementations ICLR 2019 Feng Gao, Guy Wolf, Matthew Hirn

Furthermore, ConvNets inspired recent advances in geometric deep learning, which aim to generalize these networks to graph data by applying notions from graph signal processing to learn deep graph filter cascades.

General Classification Graph Classification +1

Manifold Alignment via Feature Correspondence

no code implementations ICLR 2019 Jay S. Stanley III, Guy Wolf, Smita Krishnaswamy

We leverage this assumption to estimate relations between intrinsic manifold dimensions, which are given by diffusion map coordinates over each of the datasets.

Compressed Diffusion

no code implementations31 Jan 2019 Scott Gigante, Jay S. Stanley III, Ngan Vu, David van Dijk, Kevin Moon, Guy Wolf, Smita Krishnaswamy

Diffusion maps are a commonly used kernel-based method for manifold learning, which can reveal intrinsic structures in data and embed them in low dimensions.

Finding Archetypal Spaces Using Neural Networks

1 code implementation25 Jan 2019 David van Dijk, Daniel Burkhardt, Matthew Amodio, Alex Tong, Guy Wolf, Smita Krishnaswamy

Here, we propose a reformulation of the problem such that the goal is to learn a non-linear transformation of the data into a latent archetypal space.

Geometric Scattering on Manifolds

no code implementations15 Dec 2018 Michael Perlmutter, Guy Wolf, Matthew Hirn

The Euclidean scattering transform was introduced nearly a decade ago to improve the mathematical understanding of the success of convolutional neural networks (ConvNets) in image data analysis and other tasks.

Translation

Geometry Based Data Generation

no code implementations NeurIPS 2018 Ofir Lindenbaum, Jay Stanley, Guy Wolf, Smita Krishnaswamy

We propose a new type of generative model for high-dimensional data that learns a manifold geometry of the data, rather than density, and can generate points evenly along this manifold.

Clustering

Geometric Scattering for Graph Data Analysis

no code implementations ICLR 2019 Feng Gao, Guy Wolf, Matthew Hirn

We explore the generalization of scattering transforms from traditional (e. g., image or audio) signals to graph data, analogous to the generalization of ConvNets in geometric deep learning, and the utility of extracted graph features in graph data analysis.

General Classification Graph Classification +1

Interpretable Neuron Structuring with Graph Spectral Regularization

1 code implementation ICLR 2019 Alexander Tong, David van Dijk, Jay S. Stanley III, Matthew Amodio, Kristina Yim, Rebecca Muhle, James Noonan, Guy Wolf, Smita Krishnaswamy

Taking inspiration from spatial organization and localization of neuron activations in biological networks, we use a graph Laplacian penalty to structure the activations within a layer.

Harmonic Alignment

no code implementations30 Sep 2018 Jay S. Stanley III, Scott Gigante, Guy Wolf, Smita Krishnaswamy

We use this to relate the diffusion coordinates of each dataset through our assumption of partial feature correspondence.

Modeling Dynamics of Biological Systems with Deep Generative Neural Networks

no code implementations27 Sep 2018 Scott Gigante, David van Dijk, Kevin R. Moon, Alexander Strzalkowski, Katie Ferguson, Guy Wolf, Smita Krishnaswamy

DyMoN is well-suited to the idiosyncrasies of biological data, including noise, sparsity, and the lack of longitudinal measurements in many types of systems.

Dimensionality Reduction

Geometry-Based Data Generation

1 code implementation14 Feb 2018 Ofir Lindenbaum, Jay S. Stanley III, Guy Wolf, Smita Krishnaswamy

Then, it generates new points evenly along the manifold by pulling randomly generated points into its intrinsic structure using a diffusion kernel.

Modeling Global Dynamics from Local Snapshots with Deep Generative Neural Networks

no code implementations10 Feb 2018 Scott Gigante, David van Dijk, Kevin Moon, Alexander Strzalkowski, Guy Wolf, Smita Krishnaswamy

In order to model the dynamics of such systems given snapshot data, or local transitions, we present a deep neural network framework we call Dynamics Modeling Network or DyMoN.

Dimensionality Reduction

Diffusion Representations

no code implementations19 Nov 2015 Moshe Salhov, Amit Bermanis, Guy Wolf, Amir Averbuch

In this paper, we present a representation framework for data analysis of datasets that is based on a closed-form decomposition of the measure-based kernel.

Cannot find the paper you are looking for? You can Submit a new open access paper.