Search Results for author: Toshihiro Hanawa

Found 2 papers, 0 papers with code

Automatic Graph Partitioning for Very Large-scale Deep Learning

no code implementations30 Mar 2021 Masahiro Tanaka, Kenjiro Taura, Toshihiro Hanawa, Kentaro Torisawa

RaNNC also achieved better training throughputs than GPipe on both the enlarged BERT model pre-training (GPipe with hybrid parallelism) and the enlarged ResNet models (GPipe with model parallelism) in all of the settings we tried.

graph partitioning

Cannot find the paper you are looking for? You can Submit a new open access paper.