Search Results for author: Gleb Novikov

Found 5 papers, 0 papers with code

Sparse PCA Beyond Covariance Thresholding

no code implementations20 Feb 2023 Gleb Novikov

\] Prior to this work, the best polynomial time algorithm in the regime $k\approx \sqrt{d}$, called \emph{Covariance Thresholding} (proposed in [KNV15a] and analyzed in [DM14]), required $\beta \gtrsim \frac{k}{\sqrt{n}}\sqrt{\ln({2 + d/k^2})}$.

Higher degree sum-of-squares relaxations robust against oblivious outliers

no code implementations14 Nov 2022 Tommaso d'Orsi, Rajai Nasser, Gleb Novikov, David Steurer

Using a reduction from the planted clique problem, we provide evidence that the quasipolynomial time is likely to be necessary for sparse PCA with symmetric noise.

Consistent Estimation for PCA and Sparse Regression with Oblivious Outliers

no code implementations NeurIPS 2021 Tommaso d'Orsi, Chih-Hung Liu, Rajai Nasser, Gleb Novikov, David Steurer, Stefan Tiegel

For sparse regression, we achieve consistency for optimal sample size $n\gtrsim (k\log d)/\alpha^2$ and optimal error rate $O(\sqrt{(k\log d)/(n\cdot \alpha^2)})$ where $n$ is the number of observations, $d$ is the number of dimensions and $k$ is the sparsity of the parameter vector, allowing the fraction of inliers to be inverse-polynomial in the number of samples.

Matrix Completion regression

Sparse PCA: Algorithms, Adversarial Perturbations and Certificates

no code implementations12 Nov 2020 Tommaso d'Orsi, Pravesh K. Kothari, Gleb Novikov, David Steurer

Despite a long history of prior works, including explicit studies of perturbation resilience, the best known algorithmic guarantees for Sparse PCA are fragile and break down under small adversarial perturbations.

Consistent regression when oblivious outliers overwhelm

no code implementations30 Sep 2020 Tommaso d'Orsi, Gleb Novikov, David Steurer

Concretely, we show that the Huber loss estimator is consistent for every sample size $n= \omega(d/\alpha^2)$ and achieves an error rate of $O(d/\alpha^2n)^{1/2}$.

regression

Cannot find the paper you are looking for? You can Submit a new open access paper.