Search Results for author: Shuchin Aeron

Found 42 papers, 7 papers with code

Hard Negative Sampling via Regularized Optimal Transport for Contrastive Representation Learning

1 code implementation4 Nov 2021 Ruijie Jiang, Prakash Ishwar, Shuchin Aeron

We analyze a novel min-max framework that seeks a representation which minimizes the maximum (worst-case) generalized contrastive learning loss over all couplings (joint distributions between positive and negative samples subject to marginal constraints) and prove that the resulting min-max optimum representation will be degenerate.

Contrastive Learning Representation Learning

Interpretable contrastive word mover's embedding

1 code implementation1 Nov 2021 Ruijie Jiang, Julia Gouvea, Eric Miller, David Hammer, Shuchin Aeron

This paper shows that a popular approach to the supervised embedding of documents for classification, namely, contrastive Word Mover's Embedding, can be significantly enhanced by adding interpretability.

Learning generative models for valid knockoffs using novel multivariate-rank based statistics

no code implementations29 Oct 2021 Shoaib Bin Masud, Shuchin Aeron

We consider the problem of generating valid knockoffs for knockoff filtering which is a statistical method that provides provable false discovery rate guarantees for any model selection procedure.

Model Selection

r-local sensing: Improved algorithm and applications

1 code implementation26 Oct 2021 Ahmed Ali Abbasi, Abiy Tasissa, Shuchin Aeron

The unlabeled sensing problem is to solve a noisy linear system of equations under unknown permutation of the measurements.

Dynamical Wasserstein Barycenters for Time-series Modeling

1 code implementation NeurIPS 2021 Kevin C. Cheng, Shuchin Aeron, Michael C. Hughes, Eric L. Miller

We propose a dynamical Wasserstein barycentric (DWB) model that estimates the system state over time as well as the data-generating distributions of pure states in an unsupervised manner.

Time Series

Barycentric-alignment and invertibility for domain generalization

no code implementations4 Sep 2021 Boyang Lyu, Thuan Nguyen, Prakash Ishwar, Matthias Scheutz, Shuchin Aeron

However, the bound contains a term that is not optimized due to its dual dependence on the representation mapping and the unknown optimal labeling function for the unseen domain.

Domain Generalization Representation Learning

Soft and subspace robust multivariate rank tests based on entropy regularized optimal transport

1 code implementation16 Mar 2021 Shoaib Bin Masud, Boyang Lyu, Shuchin Aeron

In this paper, we extend the recently proposed multivariate rank energy distance, based on the theory of optimal transport, for statistical testing of distributional similarity, to soft rank energy distance.

Change Point Detection Time Series

Multiview Sensing With Unknown Permutations: An Optimal Transport Approach

no code implementations12 Mar 2021 Yanting Ma, Petros T. Boufounos, Hassan Mansour, Shuchin Aeron

In several applications, including imaging of deformable objects while in motion, simultaneous localization and mapping, and unlabeled sensing, we encounter the problem of recovering a signal that is measured subject to unknown permutations.

Simultaneous Localization and Mapping

Automatic coding of students' writing via Contrastive Representation Learning in the Wasserstein space

no code implementations26 Nov 2020 Ruijie Jiang, Julia Gouvea, David Hammer, Eric Miller, Shuchin Aeron

This work is a step towards building a statistical machine learning (ML) method for achieving an automated support for qualitative analyses of students' writing, here specifically in score laboratory reports in introductory biology for sophistication of argumentation and reasoning.

Contrastive Learning Language Modelling +2

Robust Machine Learning via Privacy/Rate-Distortion Theory

no code implementations22 Jul 2020 Ye Wang, Shuchin Aeron, Adnan Siraj Rakin, Toshiaki Koike-Akino, Pierre Moulin

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples.

Representation Learning via Adversarially-Contrastive Optimal Transport

no code implementations ICML 2020 Anoop Cherian, Shuchin Aeron

To maximize extraction of such informative cues from the data, we set the problem within the context of contrastive representation learning and to that end propose a novel objective via optimal transport.

Action Recognition Contrastive Learning +2

Domain Adaptation for Robust Workload Level Alignment Between Sessions and Subjects using fNIRS

no code implementations2 Jul 2020 Boyang Lyu, Thao Pham, Giles Blaney, Zachary Haga, Angelo Sassaroli, Sergio Fantini, Shuchin Aeron

Results: In a sample of six subjects, G-W resulted in an alignment accuracy of 68 $\pm$ 4 % (weighted mean $\pm$ standard error) for session-by-session alignment, FG-W resulted in an alignment accuracy of 55 $\pm$ 2 % for subject-by-subject alignment.

Domain Adaptation

On Matched Filtering for Statistical Change Point Detection

no code implementations9 Jun 2020 Kevin C. Cheng, Eric L. Miller, Michael C. Hughes, Shuchin Aeron

Non-parametric and distribution-free two-sample tests have been the foundation of many change point detection algorithms.

Activity Recognition Change Point Detection

Unlabeled sensing with local permutations

no code implementations14 Nov 2019 Ahmed Abbasi, Abiy Tasissa, Shuchin Aeron

Unlabeled sensing is a linear inverse problem where the measurements are scrambled under an unknown permutation leading to loss of correspondence between the measurements and the rows of the sensing matrix.

Optimal Transport Based Change Point Detection and Time Series Segment Clustering

no code implementations4 Nov 2019 Kevin C. Cheng, Shuchin Aeron, Michael C. Hughes, Erika Hussey, Eric L. Miller

Two common problems in time series analysis are the decomposition of the data stream into disjoint segments that are each in some sense "homogeneous" - a problem known as Change Point Detection (CPD) - and the grouping of similar nonadjacent segments, a problem that we call Time Series Segment Clustering (TSSC).

Change Point Detection Time Series +1

On the modes of convergence of Stochastic Optimistic Mirror Descent (OMD) for saddle point problems

no code implementations2 Aug 2019 Yanting Ma, Shuchin Aeron, Hassan Mansour

In this article, we study the convergence of Mirror Descent (MD) and Optimistic Mirror Descent (OMD) for saddle point problems satisfying the notion of coherence as proposed in Mertikopoulos et al. We prove convergence of OMD with exact gradients for coherent saddle point problems, and show that monotone convergence only occurs after some sufficiently large number of iterations.

Multi-View Graph Embedding Using Randomized Shortest Paths

no code implementations20 Aug 2018 Anuththari Gamage, Brian Rappaport, Shuchin Aeron, Xiaozhe Hu

This data is well represented by multi-view graphs, which consist of several distinct sets of edges over the same nodes.

Graph Embedding

Principal Component Analysis with Tensor Train Subspace

no code implementations13 Mar 2018 Wenqi Wang, Vaneet Aggarwal, Shuchin Aeron

Tensor train is a hierarchical tensor network structure that helps alleviate the curse of dimensionality by parameterizing large-scale multidimensional data via a set of network of low-rank tensors.

LEARNING SEMANTIC WORD RESPRESENTATIONS VIA TENSOR FACTORIZATION

no code implementations ICLR 2018 Eric Bailey, Charles Meyer, Shuchin Aeron

We present two new word embedding techniques based on tensor factorization and show that they outperform common methods on several semantic NLP tasks when given the same data.

Outlier Detection

Tensor Train Neighborhood Preserving Embedding

no code implementations3 Dec 2017 Wenqi Wang, Vaneet Aggarwal, Shuchin Aeron

In this paper, we propose a Tensor Train Neighborhood Preserving Embedding (TTNPE) to embed multi-dimensional tensor data into low dimensional tensor subspace.

Dimensionality Reduction General Classification

Faster Clustering via Non-Backtracking Random Walks

no code implementations26 Aug 2017 Brian Rappaport, Anuththari Gamage, Shuchin Aeron

VEC employs a novel application of the state-of-the-art word2vec model to embed a graph in Euclidean space via random walks on the nodes of the graph.

Graph Clustering

Efficient Low Rank Tensor Ring Completion

no code implementations ICCV 2017 Wenqi Wang, Vaneet Aggarwal, Shuchin Aeron

Using the matrix product state (MPS) representation of the recently proposed tensor ring decompositions, in this paper we propose a tensor completion algorithm, which is an alternating minimization algorithm that alternates over the factors in the MPS representation.

Matrix Completion

Sample, computation vs storage tradeoffs for classification using tensor subspace models

no code implementations18 Jun 2017 Mohammadhossein Chaghazardi, Shuchin Aeron

Our main tool is the use of tensor subspaces, i. e. subspaces with a Kronecker structure, for embedding the data into lower dimensions.

General Classification

Word Embeddings via Tensor Factorization

1 code implementation10 Apr 2017 Eric Bailey, Shuchin Aeron

We show that embeddings based on tensor factorization can be used to discern the various meanings of polysemous words without being explicitly trained to do so, and motivate the intuition behind why this works in a way that doesn't with existing methods.

Outlier Detection Word Embeddings

Unsupervised clustering under the Union of Polyhedral Cones (UOPC) model

no code implementations15 Oct 2016 Wenqi Wang, Vaneet Aggarwal, Shuchin Aeron

Similar to the Union of Subspaces (UOS) model where each data from each subspace is generated from a (unknown) basis, in the UOPC model each data from each cone is assumed to be generated from a finite number of (unknown) \emph{extreme rays}. To cluster data under this model, we consider several algorithms - (a) Sparse Subspace Clustering by Non-negative constraints Lasso (NCL), (b) Least squares approximation (LSA), and (c) K-nearest neighbor (KNN) algorithm to arrive at affinity between data points.

Low-tubal-rank Tensor Completion using Alternating Minimization

no code implementations5 Oct 2016 Xiao-Yang Liu, Shuchin Aeron, Vaneet Aggarwal, Xiaodong Wang

The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data.

Low-Rank Matrix Completion

Algorithms for item categorization based on ordinal ranking data

no code implementations29 Sep 2016 Josh Girson, Shuchin Aeron

In this context we modify an existing algorithm - namely the label propagation algorithm to a variant that uses the distance between the nodes for weighting the label propagation - to identify the categories.

Community Detection Stochastic Block Model +1

Tensor Completion by Alternating Minimization under the Tensor Train (TT) Model

no code implementations19 Sep 2016 Wenqi Wang, Vaneet Aggarwal, Shuchin Aeron

Using the matrix product state (MPS) representation of tensor train decompositions, in this paper we propose a tensor completion algorithm which alternates over the matrices (tensors) in the MPS representation.

Matrix Completion

On Deterministic Conditions for Subspace Clustering under Missing Data

no code implementations11 Jul 2016 Wenqi Wang, Shuchin Aeron, Vaneet Aggarwal

In this paper we present deterministic conditions for success of sparse subspace clustering (SSC) under missing data, when data is assumed to come from a Union of Subspaces (UoS) model.

On deterministic conditions for subspace clustering under missing data

no code implementations15 Apr 2016 Wenqi Wang, Shuchin Aeron, Vaneet Aggarwal

We provide extensive set of simulation results for clustering as well as completion of data under missing entries, under the UoS model.

Multilinear Subspace Clustering

no code implementations21 Dec 2015 Eric Kernfeld, Nathan Majumder, Shuchin Aeron, Misha Kilmer

In this paper we present a new model and an algorithm for unsupervised clustering of 2-D data such as images.

Group-Invariant Subspace Clustering

no code implementations15 Oct 2015 Shuchin Aeron, Eric Kernfeld

In this paper we consider the problem of group invariant subspace clustering where the data is assumed to come from a union of group-invariant subspaces of a vector space, i. e. subspaces which are invariant with respect to action of a given group.

Information-theoretic Bounds on Matrix Completion under Union of Subspaces Model

no code implementations14 Aug 2015 Vaneet Aggarwal, Shuchin Aeron

In this short note we extend some of the recent results on matrix completion under the assumption that the columns of the matrix can be grouped (clustered) into subspaces (not necessarily disjoint or independent).

Matrix Completion

Adaptive Sampling of RF Fingerprints for Fine-grained Indoor Localization

no code implementations10 Aug 2015 Xiao-Yang Liu, Shuchin Aeron, Vaneet Aggarwal, Xiaodong Wang, Min-You Wu

In contrast to several existing work that rely on random sampling, this paper shows that adaptivity in sampling can lead to significant improvements in localization accuracy.

Indoor Localization

An algorithm for online tensor prediction

no code implementations28 Jul 2015 John Pothier, Josh Girson, Shuchin Aeron

Then following a similar construction as in [3], we exploit this algorithm to propose an online algorithm for learning and prediction of tensors with provable regret guarantees.

Exact tensor completion using t-SVD

no code implementations16 Feb 2015 Zemin Zhang, Shuchin Aeron

Using this factorization one can derive notion of tensor rank, referred to as the tensor tubal rank, which has optimality properties similar to that of matrix rank derived from SVD.

Matrix Completion

Clustering multi-way data: a novel algebraic approach

no code implementations22 Dec 2014 Eric Kernfeld, Shuchin Aeron, Misha Kilmer

In this paper, we develop a method for unsupervised clustering of two-way (matrix) data by combining two recent innovations from different fields: the Sparse Subspace Clustering (SSC) algorithm [10], which groups points coming from a union of subspaces into their respective subspaces, and the t-product [18], which was introduced to provide a matrix-like multiplication for third order tensors.

Image Clustering

Novel methods for multilinear data completion and de-noising based on tensor-SVD

2 code implementations CVPR 2014 Zemin Zhang, Gregory Ely, Shuchin Aeron, Ning Hao, Misha Kilmer

Based on t-SVD, the notion of multilinear rank and a related tensor nuclear norm was proposed in [11] to characterize informational and structural complexity of multilinear data.

First Order Methods for Robust Non-negative Matrix Factorization for Large Scale Noisy Data

no code implementations24 Mar 2014 Jason Gejie Liu, Shuchin Aeron

Nonnegative matrix factorization (NMF) has been shown to be identifiable under the separability assumption, under which all the columns(or rows) of the input data matrix belong to the convex cone generated by only a few of these columns(or rows) [1].

Robust Large Scale Non-negative Matrix Factorization using Proximal Point Algorithm

no code implementations8 Jan 2014 Jason Gejie Liu, Shuchin Aeron

A robust algorithm for non-negative matrix factorization (NMF) is presented in this paper with the purpose of dealing with large-scale data, where the separability assumption is satisfied.

Cannot find the paper you are looking for? You can Submit a new open access paper.