Search Results for author: Zhou Shao

Found 7 papers, 1 papers with code

TriSampler: A Better Negative Sampling Principle for Dense Retrieval

no code implementations19 Feb 2024 Zhen Yang, Zhou Shao, Yuxiao Dong, Jie Tang

Negative sampling stands as a pivotal technique in dense retrieval, essential for training effective retrieval models and significantly impacting retrieval performance.

Retrieval

A New Adaptive Gradient Method with Gradient Decomposition

no code implementations18 Jul 2021 Zhou Shao, Tong Lin

Therefore, DecGD gets a rapid convergence in the early phases of training and controls the effective learning rates according to the loss based vectors which help lead to a better generalization.

Scheduling

Turing Award elites revisited: patterns of productivity, collaboration, authorship and impact

no code implementations22 Jun 2021 Yinyu Jin, Sha Yuan, Zhou Shao, Wendy Hall, Jie Tang

The Turing Award is recognized as the most influential and prestigious award in the field of computer science(CS).

CogView: Mastering Text-to-Image Generation via Transformers

4 code implementations NeurIPS 2021 Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, Jie Tang

Text-to-Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross-modal understanding.

Ranked #53 on Text-to-Image Generation on MS COCO (using extra training data)

Super-Resolution Zero-Shot Text-to-Image Generation

A New Variant of Stochastic Heavy ball Optimization Method for Deep Learning

no code implementations1 Jan 2021 Zhou Shao, Tong Lin

Stochastic momentum optimization methods, also known as stochastic heavy ball (SHB) methods, are one of the most popular optimization methods for deep learning.

Deep Learning

Attention: to Better Stand on the Shoulders of Giants

no code implementations27 May 2020 Sha Yuan, Zhou Shao, Yu Zhang, Xingxing Wei, Tong Xiao, Yifan Wang, Jie Tang

In the progress of science, the previously discovered knowledge principally inspires new scientific ideas, and citation is a reasonably good reflection of this cumulative nature of scientific research.

Cannot find the paper you are looking for? You can Submit a new open access paper.