Search Results for author: Julien Herrmann

Found 1 papers, 0 papers with code

Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory

no code implementations27 Nov 2019 Julien Herrmann, Olivier Beaumont, Lionel Eyraud-Dubois, Julien Hermann, Alexis Joly, Alena Shilova

This paper introduces a new activation checkpointing method which allows to significantly decrease memory usage when training Deep Neural Networks with the back-propagation algorithm.

Cannot find the paper you are looking for? You can Submit a new open access paper.