THC introduces a novel bi-directional compression framework to accelerate distributed deep learning by eliminating computational overheads and improving accuracy.
Tensor Homomorphic Compression (THC) accelerates distributed deep learning by eliminating computational overheads and improving accuracy.
The author introduces Tensor Homomorphic Compression (THC) as a novel bi-directional compression framework to address communication overhead in distributed deep learning. THC enables direct aggregation of compressed values, eliminating computational overhead and improving training efficiency.