Hybrid Parallel Methods

GeneralDistributed Methods • 8 methods

This section contains a compilation of distributed hybrid parallel methods for scaling deep learning to very large models. Hybrid methods combine data parallel and model parallel methods.

Subcategories