Back to All Resources

GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism

Efficient pipeline parallelism (2018) for training large neural networks.

Visit Resource