Scalable Second Order Optimization for Deep Learning

1 code implementation • 20 Feb 2020 • Rohan Anil, Vineet Gupta, Tomer Koren, Kevin Regan, Yoram Singer

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent.

Image Classification Language Modelling +2

Large Margin Deep Networks for Classification

2 code implementations • NeurIPS 2018 • Gamaleldin F. Elsayed, Dilip Krishnan, Hossein Mobahi, Kevin Regan, Samy Bengio

We present a formulation of deep learning that aims at producing a large margin classifier.

Classification Data Augmentation +1

Towards Practical Second Order Optimization for Deep Learning

no code implementations • 1 Jan 2021 • Rohan Anil, Vineet Gupta, Tomer Koren, Kevin Regan, Yoram Singer

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent.

Click-Through Rate Prediction Image Classification +4

On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models

no code implementations • 12 Sep 2022 • Rohan Anil, Sandra Gadanho, Da Huang, Nijith Jacob, Zhuoshu Li, Dong Lin, Todd Phillips, Cristina Pop, Kevin Regan, Gil I. Shamir, Rakesh Shivanna, Qiqi Yan

For industrial-scale advertising systems, prediction of ad click-through rate (CTR) is a central problem.