Orchid: Data-Dependent Convolution for Efficient Sequence Modeling
Orchid introduces a novel data-dependent convolution mechanism to address the computational complexity of traditional attention mechanisms while maintaining performance in sequence modeling.
