Emulating Distributed Deep Neural Network Training Workloads with High Fidelity and Flexibility

NeuronaBox, a flexible and high-fidelity approach to emulate distributed DNN training workloads by executing a subset of nodes and emulating the networked execution environment along with collective communication operations.