Belangrijkste concepten
EinDecomp is a novel system that leverages an extended Einstein summation notation (EinSum) and a tensor-relational algebra (TRA) to automatically decompose and parallelize complex tensor computations for efficient execution on multi-device systems.
Bourgeois, D., Ding, Z., Jankov, D., Li, J., Sleem, M., Tang, Y., Yao, J., Yao, X., & Jermaine, C. (2020). EinDecomp: Decomposition of Declaratively-Specified Machine Learning and Numerical Computations for Parallel Execution. Proceedings of the VLDB Endowment, 14(1), XXX-XXX.
This paper addresses the challenge of automatically decomposing and parallelizing tensor computations for efficient execution on multi-device systems. The authors aim to identify a suitable programming abstraction and develop an algorithm for automatic decomposition that minimizes communication overhead while maximizing parallelism.