no code implementations • 16 Feb 2024 • Reza Ghane, Danil Akhtiamov, Babak Hassibi
We study the use of linear regression for multiclass classification in the over-parametrized regime where some of the training data is mislabeled.
no code implementations • 12 Feb 2024 • Danil Akhtiamov, David Bosch, Reza Ghane, K Nithin Varma, Babak Hassibi
A celebrated result by Gordon allows one to compare the min-max behavior of two Gaussian processes if certain inequality conditions are met.
no code implementations • 3 Nov 2023 • Danil Akhtiamov, Reza Ghane, Babak Hassibi
Regularized linear regression is a promising approach for binary classification problems in which the training set has noisy labels since the regularization term can help to avoid interpolating the mislabeled data points.
no code implementations • 18 Feb 2023 • Danil Akhtiamov, Babak Hassibi
This is best understood in linear over-parametrized models where it has been shown that the celebrated stochastic gradient descent (SGD) algorithm finds an interpolating solution that is closest in Euclidean distance to the initial weight vector.