Search Results for author: Penghui Qi

Found 3 papers, 2 papers with code

Zero Bubble Pipeline Parallelism

1 code implementation30 Nov 2023 Penghui Qi, Xinyi Wan, Guangxing Huang, Min Lin

Pipeline parallelism is one of the key components for large-scale distributed training, yet its efficiency suffers from pipeline bubbles which were deemed inevitable.

Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.