Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization

1 code implementation • 28 May 2018 • Dmitry Kobak, Jonathan Lomond, Benoit Sanchez

We use a spiked covariance model as an analytically tractable example and prove that the optimal ridge penalty in this case is negative when $n\ll p$.