Search Results for author: Gregory Dexter

Found 5 papers, 0 papers with code

Stochastic Rounding Implicitly Regularizes Tall-and-Thin Matrices

no code implementations18 Mar 2024 Gregory Dexter, Christos Boutsikas, Linkai Ma, Ilse C. F. Ipsen, Petros Drineas

Motivated by the popularity of stochastic rounding in the context of machine learning and the training of large-scale deep neural network models, we consider stochastic nearness rounding of real matrices $\mathbf{A}$ with many more rows than columns.

A Precise Characterization of SGD Stability Using Loss Surface Geometry

no code implementations22 Jan 2024 Gregory Dexter, Borja Ocejo, Sathiya Keerthi, Aman Gupta, Ayan Acharya, Rajiv Khanna

In this paper, we delve deeper into the relationship between linear stability and sharpness.

Feature Space Sketching for Logistic Regression

no code implementations24 Mar 2023 Gregory Dexter, Rajiv Khanna, Jawad Raheel, Petros Drineas

We present novel bounds for coreset construction, feature selection, and dimensionality reduction for logistic regression.

Dimensionality Reduction feature selection +1

mSAM: Micro-Batch-Averaged Sharpness-Aware Minimization

no code implementations19 Feb 2023 Kayhan Behdin, Qingquan Song, Aman Gupta, Sathiya Keerthi, Ayan Acharya, Borja Ocejo, Gregory Dexter, Rajiv Khanna, David Durfee, Rahul Mazumder

Modern deep learning models are over-parameterized, where different optima can result in widely varying generalization performance.

Image Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.