Browse State-of-the-Art
Datasets
Methods
More
Newsletter
RC2022
About
Trends
Portals
Libraries
Sign In
Subscribe to the PwC Newsletter
×
Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.
Read previous issues
Join the community
×
You need to
log in
to edit.
You can
create a new account
if you don't have one.
Edit Category
×
Description with markdown (optional):
Image
Intra-Layer Parallel
Edit
General
•
Model Parallel Methods
• 3 methods
Methods
Add a Method
Method
Year
Papers
GShard
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
2020
6
Tofu
Supporting Very Large Models using Automatic Dataflow Graph Partitioning
2018
6
Mesh-TensorFlow
Mesh-TensorFlow: Deep Learning for Supercomputers
2018
2
GShard
Tofu
Mesh-TensorFlow
