Search Results for author: Shiqian Ma

Found 40 papers, 3 papers with code

An ADMM-Based Interior-Point Method for Large-Scale Linear Programming

1 code implementation31 May 2018 Tianyi Lin, Shiqian Ma, Yinyu Ye, Shuzhong Zhang

Due its connection to Newton's method, IPM is often classified as second-order method -- a genre that is attached with stability and accuracy at the expense of scalability.

Optimization and Control

Fixed Point and Bregman Iterative Methods for Matrix Rank Minimization

1 code implementation11 May 2009 Shiqian Ma, Donald Goldfarb, Lifeng Chen

The tightest convex relaxation of this problem is the linearly constrained nuclear norm minimization.

Optimization and Control Information Theory Information Theory

Efficient Optimization Algorithms for Robust Principal Component Analysis and Its Variants

no code implementations9 Jun 2018 Shiqian Ma, Necdet Serhat Aybat

Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision.

Highly accurate model for prediction of lung nodule malignancy with CT scans

no code implementations6 Feb 2018 Jason Causey, Junyu Zhang, Shiqian Ma, Bo Jiang, Jake Qualls, David G. Politte, Fred Prior, Shuzhong Zhang, Xiuzhen Huang

Here we present NoduleX, a systematic approach to predict lung nodule malignancy from CT data, based on deep learning convolutional neural networks (CNN).

Computed Tomography (CT)

Structured Nonconvex and Nonsmooth Optimization: Algorithms and Iteration Complexity Analysis

no code implementations9 May 2016 Bo Jiang, Tianyi Lin, Shiqian Ma, Shuzhong Zhang

In particular, we consider in this paper some constrained nonconvex optimization models in block decision variables, with or without coupled affine constraints.

Global Convergence of Unmodified 3-Block ADMM for a Class of Convex Minimization Problems

no code implementations16 May 2015 Tianyi Lin, Shiqian Ma, Shuzhong Zhang

The alternating direction method of multipliers (ADMM) has been successfully applied to solve structured convex optimization problems due to its superior practical performance.

Primal-Dual Optimization Algorithms over Riemannian Manifolds: an Iteration Complexity Analysis

no code implementations5 Oct 2017 Junyu Zhang, Shiqian Ma, Shuzhong Zhang

For prohibitively large-size tensor or machine learning models, we present a sampling-based stochastic algorithm with the same iteration complexity bound in expectation.

BIG-bench Machine Learning Community Detection +1

Geometric descent method for convex composite minimization

no code implementations NeurIPS 2017 Shixiang Chen, Shiqian Ma, Wei Liu

In this paper, we extend the geometric descent method recently proposed by Bubeck, Lee and Singh to tackle nonsmooth and strongly convex composite problems.

regression

Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization

no code implementations5 Jul 2016 Xiao Wang, Shiqian Ma, Donald Goldfarb, Wei Liu

In this paper we study stochastic quasi-Newton methods for nonconvex stochastic optimization, where we assume that noisy information about the gradients of the objective function is available via a stochastic first-order oracle (SFO).

Binary Classification General Classification +1

Barzilai-Borwein Step Size for Stochastic Gradient Descent

no code implementations NeurIPS 2016 Conghui Tan, Shiqian Ma, Yu-Hong Dai, Yuqiu Qian

One of the major issues in stochastic gradient descent (SGD) methods is how to choose an appropriate step size while running the algorithm.

Stochastic Optimization

An Extragradient-Based Alternating Direction Method for Convex Minimization

no code implementations27 Jan 2013 Tianyi Lin, Shiqian Ma, Shuzhong Zhang

The classical alternating direction type methods usually assume that the two convex functions have relatively easy proximal mappings.

Fast Alternating Linearization Methods for Minimizing the Sum of Two Convex Functions

no code implementations23 Dec 2009 Donald Goldfarb, Shiqian Ma, Katya Scheinberg

We present in this paper first-order alternating linearization algorithms based on an alternating direction augmented Lagrangian approach for minimizing the sum of two convex functions.

Efficient Algorithms for Robust and Stable Principal Component Pursuit Problems

no code implementations26 Sep 2013 Necdet Serhat Aybat, Donald Goldfarb, Shiqian Ma

Moreover, if the observed data matrix has also been corrupted by a dense noise matrix in addition to gross sparse error, then the stable principal component pursuit (SPCP) problem is solved to recover the low-rank matrix.

Optimization and Control

An Alternating Manifold Proximal Gradient Method for Sparse PCA and Sparse CCA

no code implementations27 Mar 2019 Shixiang Chen, Shiqian Ma, Lingzhou Xue, Hui Zou

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data.

Accelerated Dual-Averaging Primal-Dual Method for Composite Convex Minimization

no code implementations15 Jan 2020 Conghui Tan, Yuqiu Qian, Shiqian Ma, Tong Zhang

Dual averaging-type methods are widely used in industrial machine learning applications due to their ability to promoting solution structure (e. g., sparsity) efficiently.

BIG-bench Machine Learning

Stochastic Zeroth-order Riemannian Derivative Estimation and Optimization

no code implementations25 Mar 2020 Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma

We consider stochastic zeroth-order optimization over Riemannian submanifolds embedded in Euclidean space, where the task is to solve Riemannian optimization problem with only noisy objective function evaluations.

Riemannian optimization

Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold

no code implementations3 May 2020 Bokun Wang, Shiqian Ma, Lingzhou Xue

However, most of the existing Riemannian stochastic algorithms require the objective function to be differentiable, and they do not apply to the case where the objective function is nonsmooth.

Low-Rank Matrix Completion Riemannian optimization

Manifold Proximal Point Algorithms for Dual Principal Component Pursuit and Orthogonal Dictionary Learning

no code implementations5 May 2020 Shixiang Chen, Zengde Deng, Shiqian Ma, Anthony Man-Cho So

Second, we propose a stochastic variant of ManPPA called StManPPA, which is well suited for large-scale computation, and establish its sublinear convergence rate.

Dictionary Learning

A Manifold Proximal Linear Method for Sparse Spectral Clustering with Application to Single-Cell RNA Sequencing Data Analysis

no code implementations18 Jul 2020 Zhongruo Wang, Bingyuan Liu, Shixiang Chen, Shiqian Ma, Lingzhou Xue, Hongyu Zhao

This paper considers a widely adopted model for SSC, which can be formulated as an optimization problem over the Stiefel manifold with nonsmooth and nonconvex objective.

Clustering

Robust Low-rank Matrix Completion via an Alternating Manifold Proximal Gradient Continuation Method

no code implementations18 Aug 2020 Minhui Huang, Shiqian Ma, Lifeng Lai

This problem aims to decompose a partially observed matrix into the superposition of a low-rank matrix and a sparse matrix, where the sparse matrix captures the grossly corrupted entries of the matrix.

Low-Rank Matrix Completion Riemannian optimization

A Riemannian Block Coordinate Descent Method for Computing the Projection Robust Wasserstein Distance

no code implementations9 Dec 2020 Minhui Huang, Shiqian Ma, Lifeng Lai

We show that the complexity of arithmetic operations for RBCD to obtain an $\epsilon$-stationary point is $O(\epsilon^{-3})$.

Projection Robust Wasserstein Barycenters

no code implementations5 Feb 2021 Minhui Huang, Shiqian Ma, Lifeng Lai

One of the popular solution methods for this task is to compute the barycenter of the probability measures under the Wasserstein metric.

Clustering Riemannian optimization

A Riemannian smoothing steepest descent method for non-Lipschitz optimization on submanifolds

no code implementations9 Apr 2021 Chao Zhang, Xiaojun Chen, Shiqian Ma

In this paper, we propose a Riemannian smoothing steepest descent method to minimize a nonconvex and non-Lipschitz function on submanifolds.

On the Convergence of Projected Alternating Maximization for Equitable and Optimal Transport

no code implementations29 Sep 2021 Minhui Huang, Shiqian Ma, Lifeng Lai

This paper studies the equitable and optimal transport (EOT) problem, which has many applications such as fair division problems and optimal transport with multiple agents etc.

Efficiently Escaping Saddle Points in Bilevel Optimization

no code implementations8 Feb 2022 Minhui Huang, Xuxing Chen, Kaiyi Ji, Shiqian Ma, Lifeng Lai

Moreover, we propose an inexact NEgative-curvature-Originated-from-Noise Algorithm (iNEON), a pure first-order algorithm that can escape saddle point and find local minimum of stochastic bilevel optimization.

Bilevel Optimization

Federated Learning on Riemannian Manifolds

no code implementations12 Jun 2022 Jiaxiang Li, Shiqian Ma

This paper studies FL over Riemannian manifolds, which finds important applications such as federated PCA and federated kPCA.

Federated Learning

Robust Speaker Extraction Network Based on Iterative Refined Adaptation

no code implementations4 Nov 2020 Chengyun Deng, Shiqian Ma, Yi Zhang, Yongtao Sha, HUI ZHANG, Hui Song, Xiangang Li

dataset confirm the superior performance of the proposed method over the network without IRA in terms of SI-SDR and PESQ improvement.

Deep Multi-task Network for Delay Estimation and Echo Cancellation

no code implementations4 Nov 2020 Yi Zhang, Chengyun Deng, Shiqian Ma, Yongtao Sha, Hui Song

In this paper, a multi-task network is proposed to address both ref-delay estimation and echo cancellation tasks.

Acoustic echo cancellation Data Augmentation

Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity

no code implementations23 Oct 2022 Xuxing Chen, Minhui Huang, Shiqian Ma, Krishnakumar Balasubramanian

Bilevel optimization recently has received tremendous attention due to its great success in solving important machine learning problems like meta learning, reinforcement learning, and hyperparameter optimization.

Bilevel Optimization Hyperparameter Optimization +2

A Riemannian ADMM

no code implementations3 Nov 2022 Jiaxiang Li, Shiqian Ma, Tejes Srivastava

The iteration complexity of the proposed algorithm for obtaining an $\epsilon$-stationary point is analyzed under mild assumptions.

Dictionary Learning Riemannian optimization

A New Inexact Proximal Linear Algorithm with Adaptive Stopping Criteria for Robust Phase Retrieval

1 code implementation25 Apr 2023 Zhong Zheng, Shiqian Ma, Lingzhou Xue

This paper considers the robust phase retrieval problem, which can be cast as a nonsmooth and nonconvex optimization problem.

Retrieval

Zeroth-order Riemannian Averaging Stochastic Approximation Algorithms

no code implementations25 Sep 2023 Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma

We present Zeroth-order Riemannian Averaging Stochastic Approximation (\texttt{Zo-RASA}) algorithms for stochastic optimization on Riemannian manifolds.

Stochastic Optimization

A Single-Loop Algorithm for Decentralized Bilevel Optimization

no code implementations15 Nov 2023 Youran Dong, Shiqian Ma, Junfeng Yang, Chao Yin

Bilevel optimization has received more and more attention recently due to its wide applications in machine learning.

Bilevel Optimization Hyperparameter Optimization

Decentralized and Equitable Optimal Transport

no code implementations7 Mar 2024 Ivan Lau, Shiqian Ma, César A. Uribe

Moreover, we propose the decentralized equitable optimal transport (DE-OT) problem.

Cannot find the paper you are looking for? You can Submit a new open access paper.