E-Sparse: Boosting Large Language Model Inference through Entropy-based N:M Sparsity

E-Sparse introduces entropy-based N:M sparsity to improve accuracy and memory efficiency in Large Language Models.