Automatic Graph Partitioning for Very Large-scale Deep Learning

no code implementations • 30 Mar 2021 • Masahiro Tanaka, Kenjiro Taura, Toshihiro Hanawa, Kentaro Torisawa

RaNNC also achieved better training throughputs than GPipe on both the enlarged BERT model pre-training (GPipe with hybrid parallelism) and the enlarged ResNet models (GPipe with model parallelism) in all of the settings we tried.

graph partitioning

WISDOM X, DISAANA and D-SUMM: Large-scale NLP Systems for Analyzing Textual Big Data

no code implementations • COLING 2016 • Junta Mizuno, Masahiro Tanaka, Kiyonori Ohtake, Jong-Hoon Oh, Julien Kloetzer, Chikara Hashimoto, Kentaro Torisawa

We demonstrate our large-scale NLP systems: WISDOM X, DISAANA, and D-SUMM.

Open-Domain Question Answering

WISDOM2013: A Large-scale Web Information Analysis System

no code implementations • IJCNLP 2013 • Masahiro Tanaka, Stijn De Saeger, Kiyonori Ohtake, Chikara Hashimoto, Makoto Hijiya, Hideaki Fujii, Kentaro Torisawa