Search Results for author:
Found 2 papers, 1 papers with code
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures
Attention based language models have become a critical component in state-of-the-art natural language processing systems.
CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers
Systems such as TensorFlow and Caffe2 train models with parallel synchronous stochastic gradient descent: they process a batch of training data at a time, partitioned across GPUs, and average the resulting partial gradients to obtain an updated global model.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
