A PID Controller Approach for Stochastic Optimization of Deep Networks

CVPR 2018 Wangpeng AnHaoqian WangQingyun SunJun XuQionghai DaiLei Zhang

Deep neural networks have demonstrated their power in many computer vision applications. State-of-the-art deep architectures such as VGG, ResNet, and DenseNet are mostly optimized by the SGD-Momentum algorithm, which updates the weights by considering their past and current gradients... (read more)

PDF Abstract

Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper