Search Results for author: Jeff Daily

Found 2 papers, 0 papers with code

GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent

no code implementations15 Mar 2018 Jeff Daily, Abhinav Vishnu, Charles Siegel, Thomas Warfel, Vinay Amatya

In this paper, we present GossipGraD - a gossip communication protocol based Stochastic Gradient Descent (SGD) algorithm for scaling Deep Learning (DL) algorithms on large-scale systems.

Adaptive Neuron Apoptosis for Accelerating Deep Learning on Large Scale Systems

no code implementations3 Oct 2016 Charles Siegel, Jeff Daily, Abhinav Vishnu

We present novel techniques to accelerate the convergence of Deep Learning algorithms by conducting low overhead removal of redundant neurons -- apoptosis of neurons -- which do not contribute to model learning, during the training phase itself.

General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.