Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems

2 code implementations • 12 Mar 2020 • Weijie Zhao, Deping Xie, Ronglai Jia, Yulei Qian, Ruiquan Ding, Mingming Sun, Ping Li

For example, a sponsored online advertising system can contain more than $10^{11}$ sparse features, making the neural network a massive model with around 10 TB parameters.