DDLBench

Distributed deep learning benchmark suite. Compare state-of-the-art data-, model-, and pipeline-parallel algorithms for distributing your deep learning tasks across GPUs.