Interactive visualization of how Tensor, Pipeline, and Data parallelism combine across 24 GPUs — hover to explore communication groups.
Click a parallelism type below, then hover over any GPU to see its communication group light up.