Search Results for author: Zhou Shao

Found 6 papers, 1 papers with code

A New Adaptive Gradient Method with Gradient Decomposition

no code implementations18 Jul 2021 Zhou Shao, Tong Lin

Therefore, DecGD gets a rapid convergence in the early phases of training and controls the effective learning rates according to the loss based vectors which help lead to a better generalization.


Turing Award elites revisited: patterns of productivity, collaboration, authorship and impact

no code implementations22 Jun 2021 Yinyu Jin, Sha Yuan, Zhou Shao, Wendy Hall, Jie Tang

The Turing Award is recognized as the most influential and prestigious award in the field of computer science(CS).

A New Variant of Stochastic Heavy ball Optimization Method for Deep Learning

no code implementations1 Jan 2021 Zhou Shao, Tong Lin

Stochastic momentum optimization methods, also known as stochastic heavy ball (SHB) methods, are one of the most popular optimization methods for deep learning.

Attention: to Better Stand on the Shoulders of Giants

no code implementations27 May 2020 Sha Yuan, Zhou Shao, Yu Zhang, Xingxing Wei, Tong Xiao, Yifan Wang, Jie Tang

In the progress of science, the previously discovered knowledge principally inspires new scientific ideas, and citation is a reasonably good reflection of this cumulative nature of scientific research.

Cannot find the paper you are looking for? You can Submit a new open access paper.