Search Results for author: Mincong Huang

Found 1 papers, 0 papers with code

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

no code implementations4 Jan 2024 Mincong Huang, Chao Wang, Chi Ma, Yineng Zhang, Peng Zhang, Lei Yu

Pipeline parallelism is an essential technique in the training of large-scale Transformer models.

Llama

Cannot find the paper you are looking for? You can Submit a new open access paper.